My males never see females when they are pregnant and nursing.

Once females are weaned from the babies is when they are tossed in iwth the males for a week, then separated till babies are born. Females are kept in groups of 2 for nursing.