The Oxford Internet Institute has always done good work but this news item from them is very disappointing.
https://www.oii.ox.ac.uk/news-events/ais-limited-understanding-of-gender-puts-health-equity-at-risk/
The gist of their complaint is that AI language models assume that sex is binary and so when dealing with issues of health might wrongly associate being a woman with having a uterus and so on.
"The researchers warn that in healthcare, where AI is increasingly integrated into health technologies, these flawed assumptions, which are often based on a model’s conflation of gender and biological sex characteristics, could lead to inaccurate advice and misdiagnoses."
So less would go wrong if health technologies &c worked on the assumption that there are more than two sexes in humans, and gender ID matters more than biology? Hmm.
The authors are experts in data science, not anything medical or health related funnily enough, and one of them goes by "they/them", which is fine but as far as I know has zero relevance to health equity.