I think it's a matter of what you're used to. The people I know that watch dubs grew up watching them, and they're not used to reading subtitles. But I've always watched things in the original language. To me, that's what their voice and personality is supposed to sound like, and anything else is just going to be someone else's impression of that. And I can't help but think of that everytime I see it.
Personally, dubbed anime always makes it feel like an American cartoon. No matter what I'm watching, it always seems like something a six year old should be watching. And, with the dubs, I just think they change more of the lines than they do with subtitles, just because some things sound a lot stranger spoken out loud in English than they do written down.
I'm on the pretty extreme side of this issue, though. If it came down to dubbed anime or none at all, I'd go with none at all.