Honestly - toilets should all be unisex and completely self contained (floor to ceiling) , lockable with a wash basin in there, a hook for bags and room for a toddler and lots of loo paper.
With glass doors for the entry into the toilet area.
Then all this worry about who else is using them would stop.