Sounds normal to me. Many of mine check out their cage every time they are put back in after a good cleaning or a rearranging.

You could switch to rats but it might be a better idea to continue feeding mice for a few feedings so it settles in to its new home. With that I'm not saying you need to feed two mice if you would rather feed one appropriately sized one. After a few good feedings then try a rat. That's what I would do.