Sorry for the delayed response. I've been away for the weekend.
Simply entering a female space is not a criminal offence on its own. Depending on what they do, it may be voyeurism, indecent exposure or some other offence.
Failure to comply with Health & Safety at Work Act or any regulations made under that Act (including the regulations requiring single sex changing rooms, etc.) is a criminal offence.