I'd leave him alone entirely for a week, except for a water change maybe, but don't disturb him for a week at all then try again. Keeep handling to a minimum until he's eating consistently then start slow.
I know it's difficult but it's for the best![]()