Why does it bug you that some people don't flinch?

I don't flinch anymore, though I did at first so I got used to it. I sometimes do jump a little though when I have one that strikes faster than expected or misses and tries to come my way!