How long has this tank been set-up before you put the guppy in it? Did you cycle the tank or just put the guppy in there? Also, how big is this tank? It sounds like it is too small if your able to pick it up and move it around.
You need to get a 10 gallon tank, with a heater, light and filter...