It's quite possible that your food isn't up to snuff. When I hear people talk about small litters and babies eaten, that's the first thing I think of.