while the actual question on the table is one of statistical risk.
No, it’s about harm. Women’s dignity and safety are at risk. They have every reason to be afraid and wary on encountering a man in a vulnerable situation. Every single one of them.
And if you try to weigh up the effect on half the population of that risk versus the detriment to the tiny population of TWs you can see where that will end up.
If someone wants to argue that a demographic shouldn't use a space because they pose a threat, they can't just point to a dictionary definition; they have to point to the incident base rates.
Assuming that the particular demographic you have in mind is men who claim to be trans, the onus is on those arguing for access to show that the men who claim to be trans do not cause harm to women that outweighs the harm to those men. They will fail. Firstly because of the numbers, as above. Secondly because the sheer presence of men, however they identify, in those situations is deeply disturbing to most women. Thirdly because the prison stats show that TIMs are convicted of sex offences at about three times the rate of regular males.
The conclusion comes back to what was said succinctly by @theilltemperedamateur : men pose a greater risk to women than other women do.