IMO, there's no problem applying tape to the probe itself. Actually, I don't consider the probe secure otherwise. And shift of the tank could move it around a little. At least that's my experience with it.
There's nothing wrong with putting the probe between the UTH and glass, but in my experience it makes the probe hard to retrieve or readjust position.