I usually skip the day BEFORE feeding day, and I don't handle for 48 hours after feeding, but handle every day between then... so I handle 4 days a week, and skip 3 days straight.
ETA: Except for Cake, I still handle the day before feeding day- because it does not affect him whatsoever. He is a voracious eater for live mice. :|