If you think hes stressed, or if you have just offered f/t then I wouldnt try again for a week.

If your nervous while holding him, he will know it! You need to realize that this little worm cant hurt you and there really is nothing to be nervous about. The more confident you are the easier handling will be.