I think if you are a sanitary housekeeper, it isn't so much of a problem. Everything around here gets washed before it's used for human consumption, counters disinfected, etc. So, the sanitary issues doesn't bother me.
As for them knocking stuff off the counter, never an issue. Both of our cats are extremely careful.