If they are just moving the babies around, but the babies are fine, then don't worry about it.

If you separate them, and then put them back together, that would probably be disastrous. Mice are territorial, and introducing new cage mates can cause fighting. You definitely do not want to do that when they have new pinks.