The problem I see with people not defending free speech is that it hasn't been defended properly for years.
Even Julie Bindel, in the car park of Aspley Library in Nottingham, said she didn't support full free speech. She said something about not believing people should be allowed to use speech that large numbers of people found offensive.
I agree there are limits on free speech, but they have to be at the level of criminal behaviour, so inciting violence or persistent harassment, abusive language and behaviour aimed at someone or a group.
Expressing opinions that offend, even large groups of people, should be defended. We need to learn to argue against ideas we disagree with, not just shut people down,