Their food isn't served to them on a silver platter in the wild.
A little aspen here and there doesn't hurt them at all. If they were eating bucket loads of the stuff though, that would be a problem. Sometimes putting down a paper towel helps with the substrate ingestion.