I'd freeze it quickly if you are going to rather than leave it for hours. If you decide to leave it with him and see if he'll take it when you are not around, then just toss it if it's still there later on.

Refusing a meal here or there isn't a big deal as long as you know he's healthy, he's of good weight and condition and nothing has changed in his environment that might be triggering it. Sometimes they just self-regulate their eating, after all it's not like someone trots through the termite mounds of Africa every Thursday night at 8:45 p.m. happily dispensing appropriate rodents LOL.

As always, double check your husbandry and your snake and if all is well that way, I'd say just relax and try again next week.