If you just got him, then let him be for a few more days/ week just to settle in. I know it's hard, but it's for the best!
And it is completely fine to get him from his hide to handle once he is acclimated and eating for you. I am rarely in the mood to handle when they are just getting active and I am just getting ready for bed hah.