Leave the foil, it makes it easier to remove when cleaning and wouldn't make a difference heat wise.
To use a heat lamp, you need to find a way to hang the lamp maybe 16" off the top of the tub.
What size UTH are you using and what size tub? I apologize if you've already stated the answers to these.