These men can 'identify' as whatever they please, but we should not be forced to go along with it. And the fact that laws are being changed, language is being changed and policy is being changed to accommodate their feelings, over other people's reality is a problem.
Can you really not see why this would be a problem for many people? Like it's not actually possible for us to have a single sex space, if men can identify their way into it.
Also your comparison with adoption is a bit silly - how does parents adopting a child impact on other people? It really doesn't.
But allowing men to legally count as women absolutely affects other people. One of the biggest bullshit lies peddled in all this, is that it's just about trans people and nothing to do with anyone else - but that's not true. When women are forced to accept men in our spaces, forced to cede medals to men on the podium, forced to give up our places on all women shortlists to men - it absolutely does affect us. There are numerous examples of this being unfair and downright dangerous to women. Male rapists in women's prisons, men winning 'all women' cycling races.
This is not about how someone identifies, which is their business. This is about the fact that everyone else is being bullied into going along with their delusion, to our own detriment.