My argument is simply that it has worked well up until now
It hasn't worked well up to now, which is why we are here discussing it. It has worked well only for the people for whom it has worked well, and nobody bothered to consider (or, god forbid, ask) the people for whom it has worked extremely badly.
I know you think that trans people are deeply nefarious, but the vast majority of trans people are ordinary people like anyone else, who value, privacy, dignity and not drawing unwanted attention to themselves. They chose what toilet to use for the same reasons you do - for privacy, dignity and safety
Echoing what someone else wrote, because it's important: I don't think trans people on the whole are deeply nefarious. The vast majority of all men aren't deeply nefarious and choose to use toilets on the basis of privacy dignity and safety too. We still don't let them into women's toilets.
Passing is very important to the majority of trans people. And they will understandably want to avoid situations where they will obviously stand out/ not pass and potentially put themselves in an unsafe situation.
Unarguably.
It's one of the challenges that in order to access transition-related healthcare you have to demonstrate that you have been "living in your gender" for a certain number of years - this can be incredibly uncomfortable for very obvious reasons.
This is indeed a problem: what you are saying is that doctors used to - I don't know if they still do - say "go and live among the women as a woman, and come back in a couple of years."
The problem is - doctors don't have the right, the power, or the authority to tell men they can use women's toilets, not once, not for a week, and not for a couple of years. They should never have done so, and having done so doesn't excuse it or make it lawful or acceptable.