Ball pythons are generally creatures of habit. If he didn't do what you normally do it could have caused him to not eat. I don't think it's about you specifically, just that something was out of order. I wouldn't worry about it, even my best eaters have off days and don't eat, I don't advise either of you to try feeding until the next scheduled time (Mondays), trying to feed every day will stress him out.
As far as recognizing, I don't think they "miss" someone that they are accustomed to. They know different scents because of how sensitive their sense of smell is, and they can see fairly well. I know mine are a lot more comfortable with me than they are if anyone else holds them, but it's more of a trust thing, not an emotion unfortunately.