"gets male genitalia"
But they don't get male genitalia. They get a simulation of male genitalia.
We know that people have had extreme body modifications because they believe they are a reptile. Are they a reptile? Or are they only ever a human who has had extreme body modifications and that split tongue is not a snake's tongue but a human tongue that is split to replicate it.
If a male person has a uterus from a female person implanted in their body. Is that a working uterus with all that male person's body connected to it and making it work. Or will it always be a body part from a female human that has none of the connectivity with the rest of the body to enable it fulfil its purpose?
Consider a penis cut out and inverted and tucked into a created body cavity in the pelvis, do you actually consider this a 'vagina'? Because it most certainly is not. It is a penis, or a piece of the bowel or another body part, that has been created into what is only ever a place where someone can insert an object, with none of the other properties or roles of a vagina. That is not what a vagina is.
That is a simulation of a vagina. It is not replacing a vagina, and it is not transplanting a vagina into a body that was formed around having a vagina.
So, why should a simulation of a vagina in a body that is not genetically created for a simulated vagina be considered a legitimate 'biological' element in the categorisation of a person's sex?
"But I think to just call trans women (who have changed themselves physically) men, isn’t right either as they are also at risk of being hurt by men who have not changed their male components."
But this point is irrelevant. Just because they are at risk of being hurt by men doesn't mean they are not 'men'. A male person who does not identify as being trans can be just as at risk, but that doesn't mean they are not 'men'.
This point designates any male person at risk of being hurt by men who have not changed their male components as being what? women? not male? not men?