I dont think this is minor at all. I get so pissed off when my guy does this but it seems as though it is learned as everyone else in his family does it.
I cant be on the phone, deeply engrossed in a book, counting (this is the worst), listening to the news or even just speaking to someone...