Your description is bang on.
Victoria Smith wrote an excellent article on this:
https://thecritic.co.uk/does-womens-discomfort-matter/
"The intangibility of discomfort — at least as it is experienced by women — has always made it vulnerable to being recast as evidence of paranoia, hysteria, bigotry or prudishness. Rather than a man take responsibility for making a woman feel uncomfortable, a woman will be offered advice on how to manage her feelings while he carries on as before....
...The Darlington verdict, while welcome, leaves questions unanswered. It does not consider Rose Henderson to have personally harassed the claimants. Very well — but what should we call someone using female-only facilities while knowing of the impact on others? It is as though Henderson’s belief in his own entitlement (or his “sense of inner worth”, as the judgment puts it) overrides any moral responsibility. The judgment also states that the overall decision in favour of the nurses “may make for difficult reading for Rose” (perhaps, for once, discomfort may get to change sides)."