Sounds like it could be one of several things... Go ahead and change the thermostat sense you already have it. Your heater core could be leaking, or just stopped up. Let the car warm up real good, then turn it off. Check under the hood around the radiator and hoses, looking for leaks. Also...