If you find it uncomfortable in any way to be in that room after or during painting, I would. It irritates them as well, or maybe more since they have a more acute sense of smell. Although it may not be deadly, it definitely is stressful, imagine yourself being in there..