Some people are afraid of dogs, too.. so don't let a dog shelter in the area, as it may decrease the value of your house. LOL.

I wonder what the conditional permit was for. Probably to occasionally be a place of business? In that regard, zoning laws (at least here in California) would be in effect, and it would be more 'understandable' To say that it would decrease the value of potential homes is ridiculous.