Yeah I'm thinking that was probably it. I let the thing run without the eggs in it and in 30 minutes it was back to normal. I put the eggs back in and the temp is pretty consistent -- between 87.9 and 90.5. This will give me males, which is what I was going for, although I wish the range was a little tighter.
Also, is there a specific humidity level I should get inside of the egg incubation boxes? I just mixed water to vermiculite at a 1:1 ratio by weight, and put it in an airtight container that I will check every 3 days or so.