Well, if it has anything to do with allergies, staying in air conditioning and away from stuff you are allergic to will help. Change the filters on your AC if you haven't lately. Exercise also makes the lungs stronger.
And, yes, anxiety can cause assorted physical symptoms, and being short of breath is one of them.
If you start to have a substantial amount of trouble breathing, go to the ER of course.