He will be fine, in fact he will probably enjoy the extra time alone. Remember that it's a snake not a dog and they can quite happily live their lives without handling. I would personally wait to feed, by the sounds of it he's pretty stressed and likely won't eat anyways.
Sent from my iPad using Tapatalk