I would disagree with the proposition that trans people are in the same category of their born sex. Medically transitioing changes them phenotypically, which effect how they are precieved. In this example that would create a new category, of people who are trans. Unless you meaningfully establish that being trans is correlated, linked, with assaulting others, at the same rates or higher as non trans men. They are different.
You may feel that you "pass" and maybe you actually do, but most men who present themselves as women do not, or at least have some sort of "tell" that makes their appearance at least "uncanny". You are proposing that men who have "medically transitioned" (what even do you mean by this? Taking female hormones only or having had their male genitals turned into neovaginas?) somehow are "changed phenotypically" (I have no idea what you mean by this, but to me, that only means they're taking female hormones and having surgical interventions to cosmetically alter their appearance, to varying degrees of success). In your version here, this then makes them a not-man, or at least different from men. In my view, this makes them a man who wants to look like a woman, but who is still a man. Nothing wrong with that. People can look anyway they want. I don't have to like it, but nothing wrong with it. Some people have bodies covered with tattoos and/or piercings. I don't especially like that, but if that's how they want to present themselves, fine.
Where your argument differs from mine is that you believe that this "changed phenotype" qualifies them to enter into female only restricted spaces and events precisely because they are "not men" but "something else". I understand that they are still men. You are trying to argue that because of this changed phenotype, transwomen behave differently (in terms of violence against women and girls) than other men. I'm not going to argue stats with you because you've already shown that you don't accept that not only do they offend at the same rate as all men, but those incarcerated are in for a higher proportion of sexual crimes than the non-transwomen men prison population. So let's set that argument to one side for a moment.
My argument to you as to why women like me do not want these "changed phenotype" transwomen in spaces or events reserved for biological females is because, regardless of how they look and even act, they are men. Any man can put on a wig, wear prosthetic boobs, don a dress and heels and lipstick and call himself a transwoman. He does not have to take hormones or get castrated. In fact, according to many of the transwomen who don't "pass" very well, no one can tell them how to "do womanhood". Heck, they can even have a beard and mustache if they want, or dangle their "lady dicks" for us to see and if we dare to say that they aren't valid transwoman, then we are bigots. There is apparently no "right" way to do transwomaning -- except when one gets caught out committing a crime against women, then the trans community cries that they never were "genuinely trans". You can see how this becomes very confusing for the ordinary woman who is unable to tell if that mana in a dress trying to present himself as a women is a "genuine" transwoman who has "changed phenotypes" (?) or a nasty man who is adopting that garb because he wants access to vulnerable women.
So my main issue with your main argument here is that as women (who are physically smaller and weaker than men) we have fought for (and won) the right to exclude men from some places and events for our dignity and safety and to give us fair chances at success in some instances. If we are now supposed to admit transwomen into those spaces and events, we have to actually admit any man, no matter how he looks or how we feel about him, into our spaces, which makes them mixed-sex. The social contract men and women had 20 years ago was that "good men stayed out so that bad men stood out". Now, we can't tell who the good men are from the bad men because "changed phenotype" men are invading those spaces. Those "changed phenotype" transwoman might all be 100% good men. We can't know that; neither can you. So, can't you see that it's a reasonable demand for women to ask these "changed phenotype" men to stay out of our spaces, especially if they consider themselves to be (as you obviously consider yourself) one of the "good guys"?