yes you need a thermostat to control the temperature of the heat mat and a thermometer to measure the temperature inside the cage.

heat mats don't change the temperature of the air in the cage so the thermometers that you have in your cage right now aren't telling you how hot the floor of the cage is.

Wait until you have a good probed thermometer and a thermostat for the heat mat before you make any further changes.