I kind of doubt there's anything really harmful, but that's up to you. You could always hold him with the other hand.