How many females can a single male breed without causing him physical harm or an outcome of less sperm count/less babies produced?

I currently rotate 6 females through a single male, two at a time.