I remove the male only if I'm planning on giving the females a break after the coming litter (especially for females that are getting older, or I've gotten attached to), otherwise I've had more problems with females getting into tug-o-war matches over babies than I've had with males killing babies. Then again, my males tend to be big ol' softies, lol.