With a good well adjusted and established colony, you can move everybody within hours. I always move the mother first, by doing so she does not see me pick up the babies and therefore does not perceive me as a threat and try to bite me, but it can be done the other way around too.