This is my experience also. While all of mine can be handled, I have two who don't fuss about being messed with, or will pop right out of their tubs and just watch us doing chores in the herp room unless they're digesting or in shed - the others hiss and dive straight for a hide if they're not already under one.
The boas are more apt to come out of their hides and up to the front of their enclosures when someone enters our herp room, but I think that's because they're just being typical begging hungry boas.