No it should not bother them much, if anything its a change so they are generally a lil more curious and explore it a lil more. You may not notice this unless you observe them at night when they are more active. I rearange everytime.
I've noticed that it can cause stress for a few days so I try to avoid doing it but I don't think its a big issue. He rearranges things on his own anyway
1.0 Normal Ball Python (Monty)
Various fish
0.1 Wife