It might be the place you're fishing.

Sometimes places get fished out, or have other factors that are detrimental to a fishery.