Some men have gender dysphoria and genuinely want to live as the opposite sex. They respect women as they wish to become and just want to fit in with them. They usually look like ordinary women and use female facilities discreetly like biological women do. Women should be accepting of men who go through this and be ok with sharing facilities etc., with them as they pose no risk to women.
Then there's autogynephilia. These are men who have a need to be validated and accepted as women by women because they still want to be dominant over women. They tend to over exaggerate their "womanliness", enjoy talking about their girl dicks, tampons etc., and command the space in female facilities by showing they are men using said facilities. This is why they get their penises out in female spaces, talk loudly about how sexy they feel wearing underwear in lingerie fitting rooms and things like that. They're also more likely to physically harm women. This is what women find threatening and feel uncomfortable with as they feel their female spaces are no longer safe. If women complain about this, they get branded bigots, transphobes and can be threatened with violence.
Not all men harm women, but a number of men do, so for the greater good, men are excluded from female spaces. It is scary that men can now identify as women without being diagnosed as having gender dysphoria because some men use this to harm women. This has been shown with countless stories of women and children being harmed in female toilets, changing rooms, hospital wards and so on by women with penises.
We don't see the same patterns of behaviour with female to male trans. Women tend not to harm men, so the female to male trans tend to be the ones with gender dysphoria who do genuinely want to be men. They respect men and don't harm them in male spaces.
Unfortunately the autogynephilia are the ones shouting the loudest at the moment. This makes it much harder for the people with gender dysphoria as they get tarred with the same brush which is hugely unfair as they are not the ones who are causing harm to people.