So he was pushing at your hand? That sounds to me like he was just checking you out to make sure you weren't something to eat or that could hurt him. He likely has poor vision in that eye, so it's only natural he'll kind of feel his way around a bit. Much like a blind person uses their sense of touch, in essence that's what he was doing.
I have an eyeless ball python, and while she sees just fine with her heat pits, it doesn't keep her from rubbing her nose/face over an object or person to get to know them better. It's actually quite remarkable to watch her doing it.
Gale