You are making blanket statements that simply don’t even stand with basic scrutiny.
It may be that some male people are not presenting as women to harass women, but this is not true for all. And I would not have the confidence of saying even that the majority are not doing it in some way to transgress the boundaries of female people.
Any male being in single sex space that is not for them is transgressing boundaries to their own benefit. This is a measure of the success of their campaign to lower boundaries to be in spaces that they should be excluded from. Some people don’t recognise when their boundaries are being breached and when they should be alarmed.
There was recently a thread where a father wished to feed their infant child the secretions from their breast and attend a breastfeeding support group. The space does not have to be a toilet, it can be any space.
Not to mention that those very male people who are there for the purpose of transgressing boundaries want some degree of alarm response from others. That is part of why they transgress boundaries. Even if it is a microagression on the female person's part of looking closely at the male person who shouldn't be there.
Even if there is no alarm reaction, the thrill of the transgression of the boundaries to be where they know they should not be may be strong.
Male people with sex offence history too often show a long history of not being caught or challenged in their build up to committing serious offence. Of course, this is not to say that all male people are like that. Or all male people with transgender identities are like that.
However, this type of thinking, the one that says to overlook the male people crossing boundaries, allows the person crossing boundaries to keep going and to go further.