I think the only people I may tend to hide some of my toon watching from are certain members of my immediate family (who've given me a lot of grief about my toon watching) and a few others. I've been dealing with this since I hit my 20s and really started paying attention to anime and during the 90s when some epic animated shows appeared (BTAS, Gargoyles, etc.).
I've been hosting a panel at some Florida conventions for years on animated guilty pleasures (including anime) where the audience names favorites both past and present and it's usually quite a hoot. There's something pleasurable (and even therapeutic) about talking about this when there's no fear of ridicule. Those of you in the Tampa Bay area can catch my next panel at next week's METROCON.