The common ground looks fairly common to me. Most here seem to be agreed that no one should experience abuse, workplace discrimination, or harrassment because of their gender presentation. All should have the right to present as they feel most comfortable. Also, given that regressive gender stereotypes are harmful to all, this could actually be seen as a good thing.
Sometimes sex does matter: this also isn't a controversial point in this discussion. Prisons and sports are cited as two examples which could result in serious harm via close proximity of XY men to XX women who have smaller bodies, muscle and skeletel mass. No arguments here either. (The trans lobby, incidentally, would take gratuitous exception to this position. You'd be ousted from your allyhood and relegated to the status of 'T'-slur before you can blink an eye).
The main bone of contention, then, seems to be changing facilities and toilets. With that example, surely third spaces are an obvious solution (or, in small cafes for example with limited space, one toilet cubicle for all with an integral wash basin and flush, fully lockable door without gaps). There's no reason why third-spaces should 'out' a trans person who doesn't want to be outed. As mother of a son too old for the ladies but too young to be let free in the gents by himself, I'd willingly use them and actively welcome them when I have him with me.
Names I will use as requested. Pronouns, if I can avoid using them at all, I'll dodge; mainly by using the passive voice rather than a constant repetition of someone's first name to make a point. I can hardly be expected to remember everyone's pronouns in the environment in which I work (with many trans and non-binary people). Avoid using them, and no one need be inadvertently offended.
Trans women and women are distinct groups with distinct biologies and sometimes their needs are distinct. In which case surely the 'kind' option is to consider the needs of both as best protects their interests?
Is any of this in any way controversial? To me, most of this seems the general position on these boards and a clear summary of these arguments, but I'm willing to be corrected if mistaken.