The problem for TRA is that they've changed the justification for being in the wrong single sex spaces over time.
It used to be that they looked their desired sex, they acted appropriately and they were a very small minority. And women had the right to challenge them.
Then they decided it was their right to be there, there is no need to look like the desired sex and the more the merrier. They shamed women for challenging them.
Clarification of the law has prove that they they have no right to be there, regardless of how they look and how they behave. Basically, they over reached and it backfired.
Obviously, law abiding men will stay out, but some arent law abiding, they are self obsessed and want to push boundaries. There's nothing special about men with gender who act like this - they are like every other abusive man.
This is what these men are angry about - they look at their community and realise they arent women, not even close. Everyone can tell, and everyone will call out their abusive behavior, just like they will when any other man does it.