I wear my shorts baggy, too, typically with lots of pockets, but would generally prefer the idea with a belt loop/clip. One of my friends has a wallet like that for his iPod classic, which he always did in the front pocket, but he dropped it when he went iPhone (which is also in his pocket).