It's up to you...it shouldn't hurt it leaving the paper on as it'll never get hot enough to do any damage or anything. I love aluminum tape btw, stuff holds forever! I would leave it as it so that when he/she outgrows that tub, you can just peel it off and retape it to the new one