While I understand that you don't have a problem, other female people do have a problem. It is not just about safety, it is about privacy too.
Toilets are not just used behind a closed cubicle door. There are quite a few aspects of female toilet usage that happen in the public space, or even now still occur with a toilet door jammed open by a pram or a walking frame / wheel chair.
I think when people think of toilet usage, maybe they have never had to use the toilets in any other way other than behind a closed door. But the needs are still there and they are real for many female people to be able to engage in public life.