Ooh! Have a read of the attached document. Very reassuring language used - if you ignore the switch to gender...
The Equality Act provides that sex, age, disability and gender reassignment are protected characteristics. This does not mean that gender-specific toilets should be replaced with gender-neutral toilets. But there should be balanced consideration of how the needs of all those with protected characteristics should be considered, based on the mix of the population and customer demand.