If they are venomous, then yes I would. Don't want the little kids or the dogs to stumble upon them.

If they aren't, then nope! (Although, sometimes the dogs take care of them before I have any say ) They help control the rodents and aren't a danger to anyone so I don't see a reason to do anything. I just let them go on their way.