Home Depot (and therefore probably just about most home improvement stores) sell what I call "shrink wrap for windows". This helps insulation a TON, and I'm able to keep my apartment a bit warmer. I probably spent $15-20 to do the windows in my apartment.