I think that actually the problem has arisen because the unreasonable demands of the TRAs has made women more hardline on some of the areas where they may have been tolerant. This has been discussed in here before.
A while ago (probably when VM transitioned) my understanding of, for example, the toilet situation was ‘women knew this was a man using them, didn’t like it but didn’t object too much because they felt the social contract would be on women’s side if there was a problem, so they could afford to ‘be kind’ and the transwoman didn’t act as if using them was a inviolable right’
Then when TRAs decide to demand women’s spaces as a right, women said ‘hang on a minute’ and therefore started to feel that any man using female facilities felt that he had a ‘right’ to be there rather than that he was aware he was there on sufferance. So it did become more political.