Sounds pretty benign to me. I'm not an expert on breeding behavior, but unless you have females he can smell I kind of doubt that's the issue.

Keep an eye on him and look for any new behaviors or if these persist. Sluggishness could just mean he was feeling sleepy, but make sure he's tongue-flicking like normal and reacting properly to his environment (like, if you go to 'boop' him on the nose, does he still move away properly?) as lethargy can be a bad sign if it persists.

This is probably just a sign of him not being in the mood for handling though, so don't worry about it for now.