Why are you playing devil's advocate though?
This isn't a theoretical situation. People are actually wandering around public places, it fetishwear, and people already don't feel entitled to ask them to leave.
So why attempt to muddy the waters?
We should all know when we are wearing clothing that is sexual to us, and we should all be policing ourselves.
All this talk of "bans" is an attempt to escape personal responsibility for our own behaviour. It's shifting the responsibility on to other people to identify what we're doing and catch us at it.
You don't take your kink around children. No, not even if you think you can get away with it.