Hmm this may be boring for you, but for those of us who have been a victim of male sexual violence it actually does matter.
This is about males who want to access female spaces. No one on this side of the discussion is singling trans people out. It’s a blanket expectation on all males, no matter how they dress, that they respect female boundaries.
It’s transwomen who are singling themselves out by expecting to be an exception to that rule.
Now, let’s rephrase your question to make it relevant to the issue. “What have men ever done to you, or anyone?” Well, to name a few.. rape, sexual assault, physical assault, voyeurism, intimidation. Not all men have done this sort of thing, most don’t do anything like that, but then those men aren’t the ones trying to access female spaces.
And it’s not only for safety, but many women (and men) are also just not comfortable sharing certain spaces with the opposite sex. That is perfectly reasonable and is to be respected too.
Now, if none of that affects you then brilliant, lucky you. But you do not consent on behalf of anyone else. And you do not determine what matters and what does not. And if this is something that doesn’t concern you, I suggest you are the one who needs to give it a bloody rest and get a life, and 🤫 while the people who do think it matters discuss.