Most commercial rodent breeders keep groups of 1.5 for weanling production. I have seen "pinky factories" in groups of 1.15+. If you are separating mice, you are limiting your production efficiency. Keep them together. By the time you pull weaners, you'll have pinkies a few days later. As some have mentioned, females will nurse any baby within its colony.