Actually there is a lot more to it than, 'must breathe'.
Jet fighter cockpits are pressurized, they would have to be for temperature control if nothing else. It's also not unusual for a pilot to release his mask and hang it off to one side for comfort. Besides safety, in the event of lost...