Maybe when you're taking the decor out it freaks him out a bit? I have my females cage behind my males and I have to feed her first then wait 10-15 minutes until she has the rat swallowed before feeding my male or she wont eat