I never rode with a halter left on under the bridle. I did do two things though depending on which horse I was riding. I puchased quite a few 'horse collars' for trail riding occasions, they were easy enough to clip a lead onto if I needed to do something with a bridle. I also am a huge fan of rope halters and always had one stuffed into a pocket.