Parasites are never "harmless". They're parasitic meaning they do not hate a symbiotic relationship with the host. They reap benefits for themselves at the cost of the host. So yes you have to treat them all. If an organism living on/in an animal was harmless they would not be called a parasite.