Hi Aaron,
The Sportmaster really comes into play above 90 MPH and in higher X dimension set ups. The shape of the lower unit bullet enhances laminar flow (water along the surface of the unit) thus directing more undisturbed water to the propeller. Above 90 MPH a bravo drive begins to generate blow out, or essentially a parting of the water over the outdrive bullet and separating the "solid" water before it gets to the propeller. As a result slip factor or inefficiency increases dramatically. We've used larger diameter 4 blades and 5 blades to help but that induces other changes such as stern lift.
In your application, to maintain skiiability and a broad range of uses, you're fine with the XR drive and may enjoy a small increase in speed 2-4 MPH with a sportmaster. If you happen to break a drive,(let's hope not....) I would then upgrade to the sportmaster, and possibly the 2 inch shorter unit if that will still get you on plane easily. As time progresses the price of these lower units (sportsmaster) will decrease and there may come a time where you can pick up a good used one for a reasonable price <$2,000 and have it as a spare or for swapout. It will bolt up to your existing Bravo upper.
Hope this helps, have fun!