You are stressing him out. How long have you had him? Have you let him settle in for at least a week? If so start handling him so he gets used to you.