If you don't want to risk it then just leave one of the male babies in with them. That's the easiest way. If you decide not to do that and try a different adult male, chances are the females would attack him (if any fighting were to happen) and not the other way around.