Hi!
Your betta should have at least a 2.5 gallon tank with a filter and heater. When you do water changes, you should change about 25-30% of the water weekly. Changing all of the water at once will put him in shock. When you replace the water, be sure to use water conditioner. I personally use Prime and highly recommend it.
Good Luck