Try the old prop so you can test one thing at a time. The exhaust should help a little and yes the larger diameter prop can hold back the rpm's. I need more info about the props. Are they the same mfg? Different mfg's use different blade designs and there may be more than just a diameter difference. You also didn't say how much larger the diameter was.
I would have suggested more pitch instead of diameter if more prop was needed.