Some BPs enjoy being handled more than others. You'll have to get to know your snakes as individuals and determine whether they are truely ok with handling or if they are stressing. If you are observing the "no handling after feeding" rule and your snake stays relaxed in your hands while he's out and he keeps a good appetite, then I'd say the amount your handling him is just fine. We all like to hold our snakes - for me, it's partly why I got into them in the first place!
From personal experience, my adult female, Ella, will sometimes seem anxious in her cage. If she's hiding, I leave her alone (a hiding BP is a happy BP). But she usually starts getting more active as the week wears on (yes, she's probably hunting for her meal) and will start poking around the top of her cage. When she gets like that, I take her out and wrap her around my shoulders and later sit and watch tv or something. Without fail she will eventually relax and just chill on my lap and when I put her back, she's much more relaxed and will usually just go off to her hide. I'd say she definitely enjoys being handled and actually asks for it!