Then I'm sure this is caused by an accumulation of stress between yesterday and today. It is really recommended that you start out handling slowly. Since he still seems nervous, it would be in his best interest if you gave him a week without handling (also, it's usually a good idea to wait to handle until after his first meal so that you can be sure he eats). Then start out by handling him for only a few minutes every day, and gradually work your way up to longer handling periods.