I disagree vehemently - but that doesn't make you unpopular, disagreement is OK
Accessible toilets are a necessity not a choice for disabled people who need the adaptations. There is usually only one accessible toilet, so it's not like disabled people can just wait for the next cubicle to become vacant; and there is a possibility that they have access to the toilet very quickly.
I disagree that being trans can reasonably be regarded as a disability - there is nothing in trans-ness that means an able-bodied transperson cannot use a standard toilet, appropriate to their sex. They do not need adaptations or assistance to use a toilet.
You may be suggesting that they have some kind of mental disability - but believing you have changed sex isn't the kind of disability that requires the use of an accessible toilet.
Just as there are hidden disabilities that do require the use of an adapted toilet, there are other disabilities that do not prevent the disabled person from using the standard toilets. For example, I don't use a disabled toilet just because I'm deaf, but on days where my other conditions are particularly bad, I do use them because need the extra supports to be safe.
Other days, I use the standard women's toilet, leaving the accessible toilet free for disabled people who really need it.
It works on trust: disabled people trust able-bodied people, including trans, to stay out of accessible toilets so they are available to the people who really need them.