I am not sure that the idea of consent really applies to what people wear in public, assuming they're not wearing anything illegal.
The topless man wandering down the street in summer doesn't need my consent, even though I'd rather not see his exposed chest (and I do find that can be very intimidating and off-putting).
The woman in the see-through leggings on the bus doesn't need my consent, even though I'd rather not see her underwear.
The man with his trousers slung low around his thighs doesn't need my consent, even though I don't want to see his boxers.
You might find it distressing to see others wearing leather or fur, but that doesn't mean they need your consent to do so.
If someone has worn something out and about specifically to get sexual thrills then you might be able to do something because of that intent but in most cases that would be difficult to prove and quite vague. Unless you can prove that someone has worn something specifically to cause distress or alarm (for example, wearing overtly racist symbols or something that's clearly obscene) then I'm not sure there's anything to do.