Why don't you get some speaker switches from Radio Shack and just switch that pair as you need? As far as running them all together I am pretty sure it works like this but you may want to verify with a stereo guru:
Two speakers on one channel:
4ohm speaker + 4 ohm speaker = 2 ohm load on that channel
So you need to see if your amp is rated as stable to 2 ohms and check your speakers to be sure they are 4 ohms each. The lower the ohms the harder it is on the amp. The better amps are usually rated stable to lower ohm loads.