My AP cages have a slot for the thermostat probe, so they don't require any tape to keep them in place, but my other cages do. I use hot glue to attach mine. I glue the cord coming out of the probe to the UTH and then put a small drop on the tip to keep it in place.
Avoid aluminum tape as it can interfere with the probes readings.