Heres what I do.

I bleach the driftwood with a bleach/water solution. Then I put it in the oven on a metal tray and bake it for an hour at 350.

That should take care of it.