It really depends on the bug. I don't know enough about wood mite entomology to say for sure, but I assume not. They do live in the woods and when winter hits, they are back in the summer, so I would assume they go dormant with freezing weather.
It might kill the ants though.
Those are the only two bugs I've personally seen in a bag of mulch.