Leave him be. It can take anywhere from 1 whole week to a month for him to be settled in. Have you gotten a meal into him yet? If not, I definitely wouldn't attempt to handle him until you've done so, no matter how hard it is for you. Other issues could be husbandry related. Can you describe your setup and post a picture?