It could be that you're storing warm water in your tank/having good insulation keeping the tank from cooling down, leaving the water in it warm. Go down to your tank and measure the outside temperature of it and check- that, or, your burner is on and the switch to turn it to pilot only isn't working or you didn't understand it right.