Are you absolutely sure the ambient room temps don't fluctuate too much? Even with a dimmer that seems like a big range if the room only fluctuates a few degrees.