If someone accuses your side of being largely ridiculous, you can't refute that by saying, "what about you?".
Like someone accusing a person of having a ridiculous haircut, they can be correct about that, even if they have a ridiculous haircut themselves.
But let's be generous, and say that it could still be fair rhetoric in some circumstances.
But your own point just doesn't mean anything. Or very little anyway. It doesn't mean that the GC feminist side is also largely ridiculous. It only means that a small number of individuals, likely not even identifying as GC feminist, can act in criminal ways over certain issues tied up with the debate. OK, how is that a response to your side being largely ridiculous?
As for Nazis, that would be a guilt by association fallacy. Also, they probably aren't going to really like the GC feminist perspective. There may be some overlap where they can agree, but that overlap is also shared with mainstream conservatives and plenty of people on the left. That it's also shared with Nazis is just meaningless.