Exactly.
If there are not two and only two distinct sex categories, defined by reference to gametes, transgenderism ceases to exist because there is nothing to transition to or from. In arguing against a rigid biological definition of sex, genderists are actually attempting to define transgenderism out of existence.
I'm surprised they can't see this logical incoherence, but perhaps I shouldn't be, since genderism doesn't generally rely on logic.