Cupid had a couple good suggestions. Don't make it a bigger deal than it needs to be. Thank them for their time, and as cupid said, just let them know you don't feel it is the right fit for you.