Cannibalism can be an issue with mice, usually it's mainly because of stress and or improper nutrition.

You can keep females together even if one is pregnant and the other is not if you have a good colony there will be no issue.

Now having a good colony with no cannibalism is where the issue lies and it can take time to get to that point.