Because you are a lot bigger than them and you can be seen as a predator going after them. In my experience larger snakes don't seem to care as much about you touching them. Juveniles seem to be a bit more skittish.