The only way to stop it is to not take part in such unfair competitions.
Alongside the point that it simply isn't fair for women to have to withdraw from something they worked for and love, many sports operate on a qualification or points system, so in order to progress or be eligible, you NEED to have participated or won points at lower levels.
So it's not just a show of defiance by refusing to participate once, these women could be risking their entire season or career! And given the general rhetoric of "hysterical women", professional talent scouts are hardly going to be delving deeply into exactly why XYZ hasn't showed up, they will just get discounted from consideration.
They are damned if they do, damned if they don't.