Have you never done actual safeguarding training?
In safeguarding it is not just about "we will make sure vulnerable people aren't harmed" it is "we will make it more difficult for malevolent people to harm vulnerable people by making situations that could theoretically be exploited increasingly rare and difficult to justify.
This means that good people who intend no harm to anyone will regularly need to be prevented from doing something that is perfectly harnless, not because there's any suspicion on them but because we don't want to normalise situations that someone else might use to harmful purpose.
Doing this creates a culture where it's normalised behaviour to stick to procedures where no one is in a position to perpetrate harm and abuse should they wish to. No category of person is exempt - we tragically have far too much evidence to the contrary that we no longer say "of course he wouldn't do that, he's a priest / a scout leader / an upstanding pillar of the community / a marvellous benefactor" - it's not casting suspicion on priests/scout leaders/community leaders and philanthropists that they aren't exempt, and the vast majority of them are genuinely good and trustworthy. The same goes for transwomen - we will not go along with any idea that it's ok to have different rules for transwomen than for any other male, not because they are all under suspicion but because it's an absolute safeguarding red line that you don't have a category that gets carte blanche to bypass the rules that apply to everyone else.