I keep all of my rodents in my un heated garage. I am in New Jersey so the temps NEVER get as cold as yours...but when it gets down to 0 or so, the garage stays around 50 or so. The body heat of all the rats and mice help keep temps up.

Mice alone would need some heat. They are too small to be able to withstand those cold temps. A space heater maybe??