No, you need to wait until he eats at least 3 times in a row for you in his new environment. I typically wait one month just to be sure with only cage maintenance as necessary (changing water, etc.). The idea is that he needs to get used to his new hides and environment and accept it as a "safe" place before being stressed by handling. To do that, you need to not interact with him except for feeding, changing water, etc.
Switching enclosures is a very stressful thing for a reptile and you want to add as little stress as possible... Stress will keep him from feeding and could cause illness also.
During this time you also want to watch for signs of mites or other issues that might need to be addressed.
I know it is hard. I just purchased a new BP, a hatchling, and she has eaten for me twice...is due to eat again Tuesday, but I am going to wait for at least 2 more weeks before handling to make sure she has a good start and has fully adjusted.