Put on a pair of dishwashing gloves (the yellow ones). It will stop you from flinching away from him.
Otherwise, just handle him for a few short sessions a week and he'll calm down. I think it took my pastel all of a couple of weeks to start treating me like furniture, and he was a year old snake previously owned by a spazzy kid so he was pretty twitchy. First time I've ever seen a snake actually FLINCH when touched - it was the strangest thing.