Here's a point of view to consider (although I know it's radical): I personally don't feel I should be coerced to pay for any service I find morally abhorrent. When I ask people if one should be forced to fund something I feel is morally abhorrent, unequivocally I receive the same answer: no.
I don't see why it should be any different when choosing whether or not I want to fund the current military structure.