In that span of time, it's most likely that he is responding to the disruption rather than getting sick unless there is really poor ventilation in the enclosure or room the enclosure is in. I'd pay attention for signs of RI and scale rot just in case, but refusing food isn't something I'd make a big fuss over considering the stress of husbandry change and then having to go in and mess with his environment.
Edit: I forgot to explain how to check. Watch for blistering, discoloration, or flaking of belly scales. Watch his mouth for bubbles, excessive saliva, or excessive yawning. Listen for raspy breathing, sounds similar to hissing but not as loud and more constant.
Sounds good to me. Thank you so much for the reply and advice! I’ll keep an eye on him.