Didn't expect it to have so many responses. My responses to some of the themes appearing in the comments so far:
The "transgender people" wording: I was referring mostly to trans women, and most responders figured this out.
"safe space are single-sex spaces": that's the crux of the issue: are you looking for a space where men are absent as well as women, are are you looking for a communal space where women gather together but men are excluded. These are different things.
"I want a women-only space so I can feel more comfortable speaking": that makes sense. In the past 60 years, (US) society generaly accepts such arbitrary preferences in the private realm, but won't enforce such preferences in the public realm. You can reject roommates based on sex since a home is the private sphere, but a landlord cannot discriminate on sex since it's not a personal interaction. That's a major distinction that still stands.
"women need single-sex spaces while men don't need them (that's a cornerstone of feminism": that's a problematic stance. It frames feminism as a separatist, if not a supremacy, movement. It renders anti-feminist rhetoric more plausible since the movement is inherently willing to create different classes of citizens.
"single-occupant bathrooms are unsafe due to isolation": that sounds like post-hoc justification to avoid a solution that could accommodate trans women (or TIM, if that's your preferred term). If multi-occupancy is needed for safety, why are single-occupancy bathrooms allowed? Is there any requirement to have an attendant at all times? If you want to have a women-only communal space, say it - that was exactly the question.
Essentially, safety concerns can be addressed with practical solutions, e.g. physical barriers (closed stalls) chaperons, monitoring. Segregation cannot be solved in any other way. I'd support public funding for safety solutions (e.g. grants to create single occupant stalls), since making people feel safe and diffusing this wedge issue is a worthy cause. But if separation is the goal, than that solution will be misguided.
And that was the purpose of the question - not a "gotcha", not a "you should let AMAB in your stall" (that was never argued), but instead - "what do you really want?"