Women who sleep with transwomen are not lesbians.
If you want to eliminate sexual orientation as a concept, go right ahead. You won't find many supporters. Sexual orientation is based on sex, and is enshrined in law, based on sex.
Also stating that unisex toilets have their place, but men who identify as women should be able to access women's toilets means you are placing men, who identify as women, over women. Even when there is an alternative.
It's not remotely surprising, but it's difficult to justify, in my opinion. Dismissing unisex toilets means you see the validation of men identifying as women as more important than women. Which indicates to me that you absolutely see them as men, not women.