Yes. Take the actual experience of the women who live locally to me. There are three men who present in women's clothing, often seen in the street, shops, dentists etc. There's no knowing what they might identify themselves as, and to women who may find themselves in an enclosed space where they're planning to use a toilet cubicle, what's happening inside the man's head is of zero relevance to the women's experience.
All three are middle aged rather than cute teens. One will have a mini skirt hoiked up more or less to his waist but is quiet, appropriate, smiles at you (actual smile, not leer), probably a man that women would feel less threatened by.
Another is over six foot and dresses as a seven year old little girl, complete with school uniform and plastic hairclips. Everyone pretends not to notice, also quiet and appropriate otherwise, but he is a man with obvious problems and women have the 'don't get involved/get into a small space with a man with issues' instinct for a reason. Many wouldn't be comfortable in an enclosed space with him.
The third has obvious and major mental health issues, is frequently seen screaming misogynist abuse if anyone dares to displease him by breathing in the wrong way, and is an obvious enormous, unstable, dangerous male. You'd have to be mad to go into an enclosed space where he was.
The whole problem is, you don't get to pick and choose.
They'll all be fine in the mixed sex provision, so will the women who are convinced they're fine until they'll one day discover they're suddenly not. But its ok, as women with more of a grip and common sense will have hung onto a single sex space for them to retreat to.