There's really no way of "fixing" it. Sometimes (quite often) they will simply grow out of it the older they get and become less fearful. However, sometimes it is just their personality and remain very skittish.

Just keep working with him, but don't overdo it to the point where he gets stressed. Handle him a few times a week for just a few minutes at a time.