My hands sweat a lot too (not my feet so much, but I'm a girl so I don't wear many close toed shoes).
I think that's the case with everyone when they're nervous or their holding something for a long time (maybe a game controller). So for me personally its not a turnoff or a turnon. It's just natural.