Not sure where you're getting your info. Maybe it's in the state you live in. But here in GA, the property owners have the right to inspect the property at any time without notice whether you are there or not. It's explicitly been in every lease I have ever signed.
I have never had that happen though. The only time someone has come in while I wasn't at home was for maintenance issues.