Honestly, you should hold off on handling him for another week or two so he can adjust to his new environment. This will increase your chances of having him accept his first meal. Waiting is hard but you're going to have 15-20 years with him so a week or two without handling isn't so bad!
After he had eaten, give him 2-3 days to digest otherwise he might regurgitate his meal. Once you do start handling him, keep it very brief at first. 10 minutes is a good amount to start off with. With time once he gets more comfortable with your presence, you can start increasing the handling time. You will probably see him start to be less nervous and start to see you as a safe place.
The first few times that I handled my ball python, she flinched every time I would touch her. After a few short sessions, she realized that I'm no threat to her and now she seems to enjoy being out of her enclosure![]()