I don't doubt that most here would agree.
I don't feel particularly anxious around men I don't know.
I don't use sex as the only factor I use in determining how safe I feel with someone.
I don't base my life... Etc.
But...
This does not invalidate the need for single sex spaces. You, or I, do not consent for all women.
I'm glad you haven't (and if you're a woman I question this) seen the potential and willing that some men have to size and strength to subjugate women. That they declare themselves to be women shouldn't make a shred of difference.
Don't you see?