I had a labret (lay-bret, not la-brey, it's latin, not french, and it's from the word labrum (lay-brum) and... another not so nice sounding word, but if you know how to pronounce the other word the pronunciation of labret should be fairly simple).
Anyway, yeah it scraped against my teeth from time to time and didnt leave much there, but I did notice after removing it that my lower incisors were slightly worn where it had been rubbing.