i don’t think it is black and white, as a pp said, he was a very complex character.
I am Jewish and yes, he was anti semitic and also misogynistic. I don’t doubt he could be deeply unpleasant to others, and I think he probably enjoyed winding people up by saying shocking/ rude/ unpleasant things. He clearly had a very twisted sense of humour. Which makes it difficult to know what his true belief systems were. I agree that he could be unkind/ verbally abusive to Patricia Neal and I know that he emotionally neglected his second child Tessa after the death of Olivia, his oldest.
Not making excuses, but he lost both his father and sister as a young child, and then became a full boarder at 7, in austere and cruel establishments that were totally male run. And then of course the war, and the brain damage caused by his aeroplane crash. Latterly, his oldest daughter died of measles age 7. Then his baby son Theo was involved in a car accident and left with brain damage; they were originally told he would die. And then, when the 3/4 surviving children were still very young, his wife /their mum had a catastrophic stroke.
He was an incredibly passionate and determined character - as pp said, the medical invention for Theo and his commitment and drive for Theo to become independent against medical opinion (and Theo did.). And then, when Patricia had her stroke, he did hours of (yes ruthless) work with her a day on her recovery, and she herself maintained that she would never have recovered without him. His children all speak fondly of his warmth, humour and time he spent with them, certainly not perfect but an involved father and also grandfather.
Having said all that, on balance, I suspect he was a shit with redeeming qualities. I doubt very much I would have liked him, but I might have enjoyed arguing with him - he liked to be challenged - and I think I would have found him funny. So that’s my twopence worth!