How long are you handling him for? I try to keep handling times around 30 minutes.
Not trying to burst your bubble but snakes don't seek out attention or want to be pet. They learn to tolerate it but handling is for the keepers benefit- not the snakes. He's just being curious.