Are you watching him eat?
Leave him alone. Chances are he's getting stressed out because your hovering over him and he's too nervous with you around to eat.