What about the websites where men record the sounds of women peeing in cubicles next to them for sexual thrills?
The ones who make selfies and videos of them wanking in cubicles with excitement at being in a women's space where women are undressed doing intimate things and share those online?
The forums where they talk about the joys of raiding sanpro bins and sticking still warm, wet tampons up their bums?
Why do you feel women should have to be non consenting participants in a male person's sexual experiences when this is abuse? Why do you feel that this abuse is justifiable so long as the male doesn't reach the point of actually assaulting someone physically?
No. Men are not wanted in women's single sex spaces. If the men's spaces don't work for them, then they need to organise for alternative spaces of their own, but this is a very powerful whitewash job that avoids looking at why women's spaces are so very, very desired and why women's voices and issues are so stridently silenced. Because to care about women gets in the way of achieving the desired access.
And that tells you all you need to know about the morality of this. And the sexism of this.