I'm not a fan of housing them together at all. Some folks do and some don't, I'm a don't.
That said, a 20 is too small for two adults IMO...put them both in the 40 and call it happy. That would give you and them plenty of room and I just don't see the need to cram as many as you can into any given space, I believe you are just asking for trouble.