My BP did this a lot when I first got him and he wasn't used to being handled at all. He will still do it occasionally if he doesn't want to be bothered. The way he shoves my hand away reminds me of a person irritably shrugging someone off when they're annoyed lol