I'be had that same problem with mice and a pirate ship decoration. I had to smash it to get them out.

From now on if I feel the need to put any of those stupid decorations in my cages, I'll be sure to plug the holes with something first