I think the concept of "minority rights" is fast becoming meaningless.
Just because you are in a minority, that does not mean you are automatically oppressed or vulnerable or that you need to have specific rights which only apply to you and not to other groups.
Paedophiles are a minority.
The landed gentry are a minority.
The privately educated are a minority.
White men are a minority.
(And some people are in all four of those groups.)
Women are not a minority.
On a global level, people of colour are not a minority.
I think it would be more constructive at this stage to refer to the rights of protected groups, rather than minorities. Because literally anyone could self-identify into a minority group on the grounds of either a made up characteristic or a characteristic which doesn't actually need protecting, and start demanding special treatment.
Trans people should have exactly the same rights as the rest of us, including the right to go about their business free from harassment and persecution. (Unfortunately trans activists do not believe gender critical women should have that right.) I wouldn't even be opposed to the Equality Act including "gender identity" (as opposed to "gender reassignment") as a protected characteristic, meaning that it should be unlawful to discriminate against someone due to their gender identity in the same way that it is unlawful to discriminate against someone due to their religion, even if you believe both are a load of nonsense. But the Equality Act also needs clarifying to make sure that sex definitely refers to biological sex, not "legal sex".
Beyond that, if trans people genuinely believe that they cannot use single sex spaces for members of their own sex in the way that, for example, disabled people cannot use non accessible spaces, it is up to them to argue and campaign for third spaces.
Because saying that you, as a male person with a gender identity, cannot possibly be expected to share single sex spaces with other male people with or without gender identities is one thing. Saying that the solution is you being permitted to share single sex spaces with members of the opposite sex instead makes no sense. You're saying, "I cannot share single sex spaces with other male people even though I am male, so female people should be forced to share single sex spaces with male people like me even though they are female." There is no logic to that at all. However you want to argue it, all you're really saying is that what you want should trump what they want because they're just (cis) women, and therefore unimportant.
The fact that trans women are a minority and women are the majority does not mean that it is the trans women who need protecting and the women who are oppressing the poor trans women by not wanting to share their spaces.
Let's be clear about this. "Trans women" is a minority that they have created and self-identified into. If they are genuinely worried about their safety when they present as women, if they feel that, for example, they will not be safe using men's toilets when wearing women's clothes, they have a choice to present as men. They have a choice to simply take their makeup and wig off, take their skirt and heels off, put some trousers and flat shoes on, and blend in.
Now I'm not saying that they should present as men in order to escape oppression. They should be able to wear whatever they like as long as it is appropriate to the situation (i.e. not bondage gear in Tesco's) without being persecuted for it.
The point is that even if they believe themselves to be women, they can disguise themselves as men very easily, given that they, like men, are adult human males, and all the rest is window dressing.
Women do not have the ability to identify out of sex based oppression. And this is something that female people who identify as trans men or non binary people will discover. They do not look like men and the world does not see them as men. They look like women and the world sees them as women. And they are affected by feminist issues such as sex discrimination, abortion, endometriosis and lack of woman-centred research in medicine. Not a single one of us has the ability to disguise ourselves as men and escape sexism by going around wearing men's clothes.
And women as a sex class intersect with many other groups, particularly where race, religion and disability are concerned. Being a woman who is also from one of these minority groups usually makes you even more vulnerable than the average woman.
So I'm not interested in "minority rights". I am interested in identifying groups of people who actually need specific rights, and protecting those. Whether that group is a minority shouldn't come into it.