He may be a younger male, scared or cold. They can retract their testicles depending on temperature or if they are scared. I have not personally seen any correlation to testicle size and fertility in rodents (or humans )