The best things ive found to control mouse odor are ...

Dont keep them in plastic or glass aquariums. Tanks have poor air flow and are designed to keep in liquids. I use kitty litter pans with hardware cloth tops.

Get a good quality bedding. Kiln dried seems to be the best as the wood will readily soak up the urine.

Adding vanilla or vinegar to the water. I have tried both methods. The vanilla works better ... but in my opinion seems to make them thirstier, it will also plug up nipples on the water bottles over time. With vinegar the only improvement was my wife seemed to complain less.

Feed a good food with fruits and veggies a few times a week. Crap in ... Crap out. Ive noticed a large decrease in smell since I went to a lab block.

Males ... they do stink ... however if you keep 10-15 together the dont seem to musk as much. Usually one male becomes dominant and will be the only one who musks.

Mice could be radiated en masse to sterilize them. However the chance is remote unless it is a lab supplying the pet shop. More than likely its a young male, young females, or they havent yet established a functioning colony. Be patient ... They'll come around.

Bryan