Yes to first part of your question. Thats why so many marriages end in divorce. People forget that being married includes sacrificing some of their single life activities.
But it doesnt sound like thats what your husband is doing. Sounds like he just needs to get out of the house and have a break after looking after children all day.
When I was stay at home mum, when my (ex)husband got home from work and come inside, the kids would be excited to see him, and I was excited to see his motorbike. I put on my helmet, jumped on that bike and went for a ride for half an hour or so, to get out, get away, feel the wind in my face, the freedom, sometimes stop for a coffee with a girl-friend, just to forget about home, and dishes, and dirty nappy's, and crying kids for a while. Then go back home, relaxed, more composed, and read my kids a bed-time story, and then say a cheeky hello with my (ex)husband. My husband understood the need for my break for freedom at the end of the day dealing with 2 toddlers, he was cool with it.