We have explained already but I will try again with smaller words.
You do not know what other people know.
You do not have that power.
But just in case you are right - if a woman is unconscious, is it ok for a man to feel up her boobs? She won't be harmed by him doing that, she'll never know, is it ok?
If you think yes - you are part of misogynistic rape culture
If you think no - your violation of female spaces is in the same category - and you are part of misogynistic rape culture
You are male.
Your claim to have female phenotype is fantasy. Fake surgical constructs are not organs. Only a misogynistic patriarchal understanding of the nature of a female body would think they are anything close.
Women do not consent to male people in single sex spaces. Some women do, but they do not have the right to consent on behalf of others. Most women want single sex spaces. Single sex spaces do not exist if you are in them.
Use unisex facilities, and live your life free and honest as the valid transwoman you are.