You should be just fine. Your males might get a little ornery during mating season, but IMO its really nothing to worry about. I have had both females and males in the same rack system and room together forever, and never had a significantly noticeable issue. As long as you aren't actually housing them physically in the same tub or enclosure, you are good.