No, I agree that breasts can be called sexual organs. I just don't think exposing breasts in public is entirely comparable to exposing penises/vaginas in public.
The idea of me or anyone else walking around outside with their dick exposed just unsettles me. Maybe it's a hygeine thing.