I would have let him be. No harm wearing your jacket upside down and from your description that was the least of his worries.

If I thought his actions would have caused him danger or a danger to someone around him, I would have said something.