Homosexuality does not require anything from anyone else. It does not need belief, validation, compliance, performance, controlled speech or perceptions, or in fact anything at all.
Homosexuality does not involve ignoring other people's consent or rights.
Homosexuality does not involve involving non consenting others in personal sexual experiences, or using others in ways that are at the shallow end of sexual abuse, (which in some cases escalates to full criminal assault, in well known cases.)
Behaviours like this are not a normal part of homosexuality, neither is fetish or performing sexual kink in public. They are merely bloody awful and illegal, unacceptable behaviours looking for an excuse. Homosexuals (and I use that term for myself because 'gay' and 'queer' no longer mean LGB) spent decades fighting the image that their sexual orientation was not the same as sexual deviance and that they were as trustworthy and as safe to be around as straight people. Is there any evidence, anywhere, of TQ voices or bodies rejecting the sexual behaviours and putting clear water between those behaviours and of being trans? Or might it be too tied into the requirement of access to women's spaces?
The whole point of 'you can't make blanket statements' about whether men who dress as women is obviously, it is not possible to tell which man wishes to use you merely for his emotional gratification, and which man intends, as is openly recorded and shared on grotty social media sites, to sit in a cubicle with the door wide, having a wank at the exciting situation he is in, and shouting at any women who try to protest that he's a woman and they can't stop him. If you say yes to the first man, you have to take the second man too. And make women submit to him.
There is no space for case by case. No one's Nigel matters. The reality is that too many people for too long have been prissy about admitting that this is, for many men, a sexual kink, an overt, open, plainly stated sexual kink, and a sexual performance using women in women's spaces. This protects the men's ability to go on abusing women and silences women from being able to have any spaces that are free of such men.