Yes they will be fine - only concern would be if they are Tungsten lights (would be very hot) and cold water on hot glass is rarely good....
As you rightly allude too, it's the ends where the power comes in that you want to worry about, but these are usually fairly water tight (i've had one...