This is fairly normal behavior for a baby, as most are little garbage disposals. Once he matures and his growth rate slows down he will chill out - and then you'll be worried when he goes on a six month fast over the winter.

I agree with handling him more during non-feeding times. I would also do things exactly the same way every time you feed so he knows the difference between feeding time and handling time.