Yes, you can. Because whether you can do it or not, you can still tell when someone is good or bad at something. To use your own argument, I'm not an actor, but I can still tell when someone is a bad actor. I don't play sports, but I can still tell when someone isn't a very good athlete.