For me it's less about what he did then and more about his tone in the retelling of it now.
The tale poses him as the brave hero, who battles the slings and arrows of hateful oppression, (cue female children).and triumphs.
The truth is, is that he didn't, at that time, have the bravery to face the actual oppression of homophobic men who punish gay/effeminate men for not upholding the status quo which I personally hold no judgement over. He was wrong to go into the female toilets, without a doubt, but I can understand why he thought that was his best option at staying safe.
I do judge a middle aged man who reframes his cowardice (however understandable that cowardice was) as bravery. I do judge a middle aged man who hasn't developed a modicum of self reflection and cannot see that his actions were an imposition and could have been seen as threatening to female children.
I do judge a man who, to all intents and purposes, brands those children as scum and pontificates on their probable wastrul lives (like he has any idea about who they were, what they had been through and who they became), especially a man who has documented his own youthful shoplifting and other delinquencies and asks of society to understand that all that was because of unfortunate circumstances, not innate dysfunction in himself.
And I definitely judge a middle aged man who calls himself a "male lesbian".
He is a misappropriating, misogynistic narcissist and the current Labour Party is an absolute shit show (mores the pity).