Depends on the body shape of a girl, if you're tall-ish, then It wouldn't really work, but it also depends on your features.
I prefer when girls have their hair down, but if you're doing sports, and you're all sweaty, then its okay.
So its not really unnatractive, but more if like, you had your hair down, you would be more attractive.