Keep handing him every once and awhile and eventually he will learn you are not a threat to him. Just try to avoid sudden movements as much as possible.

And if he is eating like a pig then he isn't very stressed out so don't worry.