In my opinion, once he has "settled" in for a week or so, I would start handling him anytime. The more you work with him the less jumpy he will be. Good luck!