Here's my question: Why didn't you take it to a vet or something? There's no way I would have had the nerves to be able to just let it be and hope it's belly closed up. I would have been on my way to an emergency vet asap.
That is sometimes common in babies that havent absorbed their yolk yet.