Sounds like he's getting used to you, yeah. Eventually he'll be either totally calm with you, or only a little jumpy, depending on his personality.
I've had my girl for 2 weeks now, and once she stops striking at almost everything, I'll consider that a victory, haha. She's a bit odd for a ball though.