It doesn't though. Because it's not about being trans. It's about being male.
Men commit 98% of all sex crime, 90% of all violent crime. Statistically men who identify as women more sexual assaults than men who don't.
And that's because of a paraphilia called autogynephilia.
Back in the mists of time, transsexuals were largely gay men who felt their femininity would be more acceptable if they said they were women.
unfortunately, the Internet, as is it's habit, has allowed the other cohort of men who say they are women, autogynephiles to entirely engulf the original homosexual transsexuals.
AGP men are largely straight, often married, and are driven, to really quite extreme lengths by their fetish. (see the transwidow's threads on this very site). They are highly misogynistic.
There is often a conflict if people know homosexual transsexuals, but listen to women who know autogynephiles.
They are not the same. They are, however, both using women.
And, of course, if you admit one cohort, you admit the other.