I voted yes.
When I handle him he always holds his head up and immediately wants to start looking around, but when others have handled him he stays balled up. When he does finally uncurl he seems to want to come back to me right away, and will only be relaxed if I'm near.
There is also the fact that I can sometimes 'read' him. What I mean is, I'll knock on his hide to let him know I'm there, but when I pick it up I can sort of just 'tell' if he is in the mood to be picked up or not. If not, then I just leave him alone. Whether that has anything to do with this poll or not I'll let you decide.
So, again, my vote is a firm 'yes.'