The speech is here
He starts with a general riff (which isn't particularly eloquent) on 'minority rights' imposing on the majority, before moving on to specifics:
{my transcript, more-or-less verbatim}
"We have a perfect example of this with the recent controversies over transgender rights. A Conservative government at Westminster is proposing some fairly wide-ranging increases to the rights of transgender people. This could mean that anyone who wishes to identify as being of a gender different to their physical gender may be able to do so simply by defining themselves as such. So we could have men entering women's public toilets because these men claim to define themselves as women. We could have male criminals demanding to be sent to women's prisons because they define themselves as women. We could end up with the girl guide movement having to accept men who define themselves as women as guide leaders because if the girl guide movement refuses to do this they may end up facing prosecution because they have somehow breached somebody's so-called human-rights. We are going to have a lot of fun with this over the next few years if we continue as a society with this kind of minority obsessed nonsense. What we need to do is have a grown up conversation about the issue of minority rights and accept that there have to be limits to them.
There is only so much deviation from the norm [boos from Assembly Members] that any society can take before that society completely implodes and if we carry on down this road of appeasing the nuttiest elements of the transgender movement then what we will face as a society within a very short space of time is total implosion.
Now having made this general observation that is not to say there is no good work in the field of human rights in Wales. There is some good work going on. But some of the concern that this report expresses is certainly in my view misplaced. [and continues on topic of prisoners voting]"
I think he is not very well informed about what has already happened in terms of transgender rights, but it seems clear that he is criticising the specific 'rights' (men's right to enter in women's spaces), rather than saying that transgender people are deviant in any way.