It depends on the current state of the animal and why its currently off feed. Excessive handling can be a contributing factor in non-feeding issues and could prolong the problem.

If I have an animal that is not eating for me I will usually not handle them outside of cleaning and tub maintenance until they start to feed regularly again.