@Igneococcus I haven't heard today's podcast, but in the past I have heard him handwave it away (mainly as 'culture war'). RS too, though he seems to be slightly improving. I think it's important that we don't have policy silos that only some people are deemed to have the right to speak on.
But from what earlier posters wrote, it seemed like what AC was trying to do was to say that he should defer to women more on this issue. Deferring to 'women' on this issue would not solve the issue, because, bizarrely, I think it's been largely women in the vanguard of the push to erode sex-based rights and norms. That's an even bigger problem than men-in-women's-spaces (because it includes that issue, plus more, and it removes the tools that society has to remove men from women's spaces). Ruth Hunt, Teresa May, Caroline Nokes, Nicola Sturgeon, Judith Butler, established women's charities.
I was reflecting to work out whether I was cherry-picking with that list, but (while recognising that there are also lots of men doing the same) I don't think I am. It accords anecdotally with my experience in real life.
If we deferred to the people with the strongest opinions on this issue amongst the people I know personally, we would permit men in women's spaces, not because of the men but because of the women.
I'm not sure I'm really disagreeing with any point of yours, unless you are saying that if we only listened to women this would be fixed. I don't think it would be.
I think men do have an additional responsibility to speak up on this issue because men have additional cover to do so. But not because men caused this. That isn't defensiveness from me. I think it's weird so much of the push has been from women. But it does seem to have been so.