Ah that clarification would have been handy earlier :p
Thermometer is fine in the cage then. Only thermostat probes for UTH need to be outside.
Here is a chart to help clarify more.
Just keep in mind you will want to measure your hot spot UNDER the substrate, ideally with a temp gun. Wired probed thermometers can work too but I find they are not as accurate for surface temps.