The fact he said gender is a fact and not sex is a fact makes me believe he doesn't actually know what he's talking about at all.
In his set he said women look at Transwomen like black people look at blackface, and they get upset because it's mockery... I mean. Yeah, kinda see where he was going with that. Transwomen are the epitomy of harmful female sexist stereotypes, but we're not just upset at that.
We're upset because it's a full safeguarding issue! Because sexual predators sit next to little girls in a spa and little girls get called bigots for not wanting to see a semi erect penis in women's spaces. We're mad because for every time someone says It Never Happens, guess what, it happens.
I know he can't really convey all of that on set. But how can you fundamentally call yourself a feminist if you think that the reason we're upset is simply because we're being mocked?