Nanunanu as ridiculous as this seems now, one of the many early arguments against women in Parliament was that there weren't any toilets they could use.
Crudely put: if there is nowhere even nominally safe that I can go to the loo when I am out, then I am restricted to where I can go. If I cannot go to the swimming pool or gym because I will be forced to share changing rooms with people with penises, then I cannot swim or use the gym. If I cannot send my daughters to a school trip because they will be sharing bedrooms with teenage male-bodied people, then they will be excluded from a part of school life. And so on and so forth.
(I don't have daughters, I have a son, but I have already had to persuade one other mum I know - against my better judgement - not to withdraw her incredibly bright daughter from school because there are no girl's loos, only gender-neutral ones. In this case I think the loos are OK as they are specially-designed single stalls off a common corridor, but if they were old-style loos where there are single stalls in an enclosed room with one entrance/exit, and it would be easy to be trapped, I would have to have agreed with her.)
I am sorry that women hurt you. Nobody should be hurt by anyone. However, you are the outlier - violence is perpetrated, overwhelmingly, by men, and most violence against women is overwhelmingly perpetrated by men.
You are right that nowhere is a "safe space" - not at home, not in public. But there are degrees of safety, and ways in which women navigate the world knowing they are at risk. And women are now being constantly told that - against all their life experience and knowledge of the world - their fears about being trapped in intimate circumstances with male-bodied people are silly and irrational, and that they should accept that and shut up. Consider, for example, the posters in women's loos in universities that say "If you are in a public bathroom and see a stranger whose gender does not match the sign on the door, follow these steps: 1) don't worry, they know better than you." This is explicitly telling women not to trust themselves, that they should not ever raise the alarm about someone obviously male in a woman's bathroom or other intimate space, in case they inadvertently hurt someone else's feelings. This is what women have been told from time immemorial: that male feelings are more important than women's safety.