I've not been giving "my logic", I've been explaining the law (particularly in the face of people repeatedly getting it wrong).
Though I will say that I'm not particularly concerned about a law as it is.
For example, if in a situation like the TR one, if the servers in the restaurant were Muslim, I'd be far more concerned about the employers duty of care towards their staff than I would TR's "right" to be served by them.
I'd also be more concerned about a business owner's right to refuse service to, say, a paedophile advocacy group, if their repeated presence deterred other customers.
If it got to the stage where someone like Robinson was so routinely denied service that he was meaningfully impeded in functioning in society, perhaps I would start to feel differently (whilst wondering what exactly could be done to balance everyone's interests/needs), but we're a million miles from there.