I normally would say it is ok to put mamas and babies together, but for this situation I would advise against it.
You mentioned that one of the mothers had 3 larger babies and the other mother had normal sized litters.
Usually what happens when you put mamas and babies together is that the mothers make one giant nest and combine the litters. I'm a little concerned that the larger pups will push the smaller ones away.
I've put together a litter that had larger pups with one that had smaller pups before. The entire litter of smaller pups except for 2 starved to death because the larger ones always pushed them out of the way when they were nursing.