From personal experience, I would say keep the enclosure away from exterior walls! Unless you put up extra insulation on the wall, the cage will be affected by the added cold.

But yes, also keep it away from drafts, direct window exposure, and high traffic/loud areas.