He has the right to refuse to deal with you for no reason at all. So he is erring on the side of caution, which I do not blame him for.

Maybe he IS overreacting some, but it's his collection at stake, so it's his call to make.
Just my opinion.