The argument I've heard against the former is that everyone ends up paying taxes and otherwise indirectly contributing to your business, so it isn't right to deny them access.

At the same time, though the business owner also contributed their own taxes to the situation.

I think I agree with your distinction and stance, with the idea being that the market will correct because it's shitty business to turn away a customer over an irrelevant detail like that