yes you would need a humidifier instead of a dehumidifier....decent ones can be bought from walmart or target for 30-60 $$

I would look at just getting a better room heater honestly.