Raising the humidity in the incubator could help, but there is no need to control the incubator humidity if your egg boxes are sealed. I would recommend mixing up another batch of incubation medium in a new egg box, transferring the eggs over and sealing it up from the start. They should all make it if you can get the humidity up to ~100% soon. I have had very sunken eggs hatch just fine.
-Evan