i would take the male out. when i bred mice i always separated the males. the issue would probably be the females eating the babies. rats on the other hand my female rat had a litter while the male was still in the tub with her and they were getting along just fine before i separated them and no babies were eaten by the momma.