There is a big difference between asking for tolerance and respect for someone else's beliefs and requiring someone's active participation in a belief they do not hold.
It is absolutely within the bounds of reasonability that a heterosexual male encounter no discrimination in employment or legal rights on the basis of how they choose to present, name themselves, dress, or to record themselves as a TW. It is reasonable that they may prefer alternative facilities than male ones for their safety, dignity and privacy particularly in situations that involve undressing or vulnerability.
It is not reasonable to require female people who do not share a belief that a male person becomes something other than a male to participate in that belief not just with words or actions but with their own body, by being willing to toilet, undress and sacrifice their own privacy, dignity, and in the case of lesbians to have it suggested that sexual access should be included. This is requiring women to submit their bodies to a political movement. Against their own beliefs. Their own needs. Their own consent. Their own autonomy. With penalties of how they will be spoken of, treated, threatened and shunned for stating boundaries. Twitter examples easily found.
This is fact. This is happening. This is the reality.
Either everyone gets to name their boundaries, to have their privacy, dignity, safety and personal beliefs recognised and provided for, equally, or we stick to entirely sex based provisions. Because there cannot be two classes of people: those who get to have such things, and those who must go without and accept subordination. This is a caste system embedding inequality, and this is where the word 'privilege' does a lot of heavy lifting trying to make that underlying inequality and differing standards and treatment ok.
Compare the 'hate' of 'I am an adult human female' and 'I want female only spaces', with 'die in a grease fire'. One is supposed to be appalling; ffs we have students talking about how sad it is there is no death penalty for an academic saying such things. The other is considered perfectly justifiable and rightful punishment for the crime.
Which is largely to be female and to say so.