Oh that is an interesting document.
There is a whole section about trans only swimming sessions that I don't think anyone would argue with if the inetrest is enough to make it viable. This bit though:
"The trans community is very similar to some faith communities in terms of the privacy initially needed when accessing the pool."
But those same faith communities will not be able to attend any more as a result of their policies soooo.....
Reading on 
There is a lot about how trans people need lots of privacy and stuff which also presumably women, whether trans or not, don't.
Of course many men don't like to get undressed in front of people with vaginas & breasts either, however people with vaginas and breasts are far less likely to be keen to get into the mens changing to watch them taking their clothes off, and the physical threat is completely different. Both in terms of likelihood and ability to carry it out.