I would move him too. Especially if he is a good little guy and not showing huge outward signs of stress, it shouldn't bother him too much. A good set up is the most important thing.