It's very tricky for an observer just wanting facts, because the facts we need are being withheld and people are filling in the gaps. Some of these people have the professional and educational background to form intelligent and objective conclusions, some are consciously or subconsciously interpreting the situation according to a personal agenda, some are outright troublemakers, and many are just sports fans who, quite reasonably, didn't ask to be obliged to understand the minutiae of DSDs and say something based on the last headline they read rather than saying, as the OP has said, "I don't know, I want to understand," or, "I don't know, I can't comment."
A clear and credible statement from the IOC that these athletes do not have XY chromosomes, they have XX chromosomes, might have avoided a great deal of hot air, the wasting of a great deal of many people's time, and a lot of the hostility being directed at the IOC and the athletes. The fact that such a statement has not been forthcoming appears significant.
I can think of a number of individuals who say that self-ID and/or males with DSDs should be allowed to compete in women's sports, but none of whom I could say, "They're credible, they know a lot about this stuff, I should give some weight to their opinion."