Moving could be a long-term solution. Or, you could develop new allergies, to whatever blooms in your new home.
In the short term, the best thing to do is minimize mold in your home. Air conditioning is your friend (make sure you change the filter regularly), as is watching for leaks. When I get home after being exposed to allergies, I shower and change clothes, and put the dirty clothes in the laundry basket OUTSIDE the bedroom. I also wash sheets frequently during allergy season, and keep my bedroom tidy.
On the really bad mold days, minimize time outside. When you have to go outside, consider wearing a mask to reduce exposure.
In the medium term, like MountainReader said, immunotherapy or allergy shots prove helpful for most people who stick with them. I just started my shots a few days ago (fingers crossed!)