I have a female who is hissy at times. I wouldn't let it bother you too much. Focus more on his posture and it if he looks like he is getting defensive. My female hisses just to hiss no other defensive behavior. My opinion would be to continue to handle even if he does get a little hissy... If he hisses and you leave him alone he will hiss knowing that you will leave him alone. If he hisses and you notice he's super stiff and in a defensive position then I might back off or cover his head.