Those comments were made together in the same interview re self-ID, and needing to take changes further, trans communities being the most marginalised and Rosie Duffield being wrong. I think that as they were given at the same time, it's a fair assumption that it was talking about self-ID and removing single sex spaces etc.
Rosie Duffield is only wrong if you're referring to gender though - so he could have clearly made reference to the GRC while acknowledging biological sex as separate and distinct. But he didn't. Which effectively threw Rosie back under the TRA bus.
I think it's possible to pick apart each piece of evidence re Keir's views individually but sometimes it's a case of the sum being greater than the parts. When you put everything together, he seems to have been a vocal supporter of ushering self-ID along and implementing more changes to support trans rights.
I agree with you re I don't wish anyone any harm. And I know there are plenty of trans identifying folks out there who just want a quiet and peaceful life. And I genuinely wish them all the happiness they can find. But this mustn't be at the expense of women, or by eroding our unique identity. And that seems to be what most politicians are happy to sign us up to. I think Keir is in the middle and could swing either way.
What I would say is that more recent comments from Keir have started to allude to biological women - the comments I mentioned above were from early last year. So it's possible he's seeing the tide turning within our culture - and I think it is - and moderating his language to align with that. Because as you said, it's about the votes and being seen to say the right thing.