No you don't have to remove that cap to get the bowl off. Use a couple of screwdrivers and pry the bowl back. The shaft and the bushings may create a vacuum when its coming apart and it will seem like something is holding it on but it will come off. If in doubt read the manual...
Pump overhaul manual