Yeah take the male out once you have babies or else bad stuff might happen as far as eating babies, attacking females, etc. Usually it is not a concern, but sometimes the male goes rouge and you get problems. Nice job starting your own breeding, MAKE SURE the mice you got are healthy as you want healthy babies and also make sure it doesn't get too hot, no one runs out of food or water, they have stuff to hide in. These things are all of the things i have noticed will make females get scared and start eating their young.