Stop moving them around. I don't breed ASF's but my mice and rats both like to alternate between multiple piles and one big one. Just because you don't see both moms on the nest dosn't mean they're not taking turns.

Nature knows what to do.
As long as your babies are healthy, just watch and enjoy.