He needs to get use to you. For now just hold him with out stroking him. Let him relax and explore on his own. When he figures out that you will not harm him. He will relax. Don't rush him. You will tell when he's ok with handling other than just holding him. Also he may need a little more time to settle down. When you stroke him it may seem to him that you are a predator getting ready to eat him. So he's a bit defensive. Just give him some time.