Very few drivers will stop because of the fear of being robbed/assaulted/murdered by the person they pick up.
One person told me I was a "shady looking character" but I am a totally honest and respectable middle aged HR manager, stuck in a suit during the week and dressing casual on weekends...