Depends on whether you want to keep the humidity inside the incubator up, or if you control humidity inside your egg boxes instead.
If the egg boxes are tightly sealed, you can do that, otherwise they tend to dry quickly if incubator humidity is low.