I'm gonna have to agree with the others though 3-4 times a day is just too much stress on him in his new environment.
Also since he DOES not like you yet and does not feel comfortable I would only recommend handlin times of 5 minutes or so at a time, short and sweet.
This has nothing to do with the color of his scales he's just fiesty. Just remember, the more you back down the more he's gonna know he has power over you, show no fear.
And keep in mind, a rodent will bite you way harder than a corn ever will.