I think women are entitled to say that women's sports should be for female athletes only without having to demonstrate to you or anyone else that they have met a minimum threshold for caring about women's sports or any other feminist issue.
A group of women saying, "we don't want to include male athletes in women's sports" is a good enough reason on its own.
There is absolutely no argument for including male athletes in women's sports that does not ultimately boil down to "because it's what trans activists want".
Why should what trans activists want take priority over what female athletes and people who care about women's sports want?
You're right that there are certain people using the trans issue as an excuse to roll back women's rights in general. It should not be possible for them to do this. They would not be able to make political capital out of knowing what a woman is or saving women's sports if their political opponents hadn't made the CHOICE to throw women under a bus to please trans activists.
The blame for this lies solely with the Democrats and their equivalent in other countries.
Just like last year, when people were saying, "the Tories go on about knowing what a woman is but will they actually do anything for women?", they were failing to grasp the exact same point. It should not be possible to get one over on your political opponents by knowing what a woman is. Everyone knows what a woman is, and nobody should be pretending not to.