That's what I would suggest as well. Hang out with him for a while and let him learn there's nothing to fear. I know personalities are different, but I had a very timid BP who would ball up tightly upon removing. So I just hung out on the couch with him and sometimes after 30 minutes he'd finally loosen up and start looking around and I encouraged him to crawl on my arm and from hand to hand. He eventually became a great pet and lost the shyness.