Could he possibly be hissing?

Since you say you only hear it when you pick him up, and he's also acting skiddish, I'm wondering if he's just not too happy/used to the handling. How long have you had him?