You need to realize that the thermometers that we use in the hobby are cheap and inaccurate. Cheap thermometers have what is called error. Error is the amount off from the actual temperature that the thermometer reads and can still be "working properly" according to the thermometer manufacturer. Most are in the +/- 2-6 degrees F range so your thermometer could very easily be reading 96 even though the actual temperature is 92. Trust your herpstat. You payed a lot more for that than you did for your thermometer or temp gun (which are usually just as inaccurate as the thermometers) Herpstat probes are accurate to +/- 0.9 degrees F which makes them many times more accurate than anything else you have to measure temperature. Unfortunately accurate thermometers usually cost hundreds if not thousands of dollars so they are out of the reach of many hobbyists.
You can try replacing the batteries, low batteries will effect the readings of a digital thermometer. But as I said before cheap thermometers are inaccurate and their readings should be taken with a grain of salt.