No, it's nothing to do with "all Jews'.
Chaim Herzog is a former President of Israel, as State which is now widely held in contempt by other nations because of a litany of behaviour that stems back past Chaim Herzog's time. Hardly a surprise then that there is perhaps a reconsideration of whether it is appropriate to honour Herzog or not.
And by extension, it's OK to single out individual Jews to punish them for the transgressions of a country they don't live in and possibly have never even visited?
This is palpably ridiculous when the individual being discussed is a former Head of State of Israel, hardly someone who "never lived in Israel or possibly never even visited".
You don't want to accept that that is anti Semitism. But that is what it is
Again no. It's unquestionably anti-Israeli, and unquestionably anti-Chaim Herzog. It is not anti-Semitism.
There was a time when all Irish people living in the UK were pretty equally held in contempt and suspicion because of certain political circumstances, and iirc we didn't like that one bit
Of course, and this is every bit as reprehensible as holding all Jews in contempt and suspicion, but neither Israel, nor Chaim Herzog are "all Jews".