Are you offering every day?
If he is otherwise healthy I would just be patient with him. I feed my babies about once a week. If they refuse food, I just wait a week and try again. Same with my adults only the interval between feedings is longer. Constant offerings of food when he's not interested can be stressful for them, so I would just give him some space.