The problem isn't the diameter so much as the material. Switch out to a good grade 8 black oxide coated fastener and see what happens. You'll need to get under there every so often and see how they're fairing against rust, but they should be more than strong enough. Stainless just doesn't posses the shear strength you need.
Good luck
Chris