I think it is worth telling you a story about a friend of mine (well really a colleague at work, as after I left that workplace we didn't keep in touch) a number of years ago. She went for the first time on a trip to New York, and came back raving about it, and one of her comments was, "they are so much less racist in the US than they are in the UK". And I did a bit of a double take, because, having spent a couple of years in the US, my definite impression is that the US is worse than the UK. And I looked at her, and then I said "X, it is not that New York is less racist than here, it is because in the UK you are classed as "black" and in the US you are classed as "white"". Because you see, she was/is a light skinned person from India. In the UK, that makes her "Asian", and everybody identifies her ethnic origin and puts her together with people with origins from Pakistan and Africa who are classed as "not white". In the US, they go a lot more on actual skin colour, and the divide is more linked to slavery and the history of many African Americans. And that meant that when she walked into a random shop in New York, she got treated with white privilege. Which to her felt liberating, and she assumed it was like this for everyone.
And the only reason I could figure this out, was because I had had an experience a few years previously when I met up with an African American who had travelled on holiday in Australia, and was raving about how non racist they were. Which if you know anything about the prejudices in Australia (where I grew up) seemed extraordinary, but he absolutely insisted. And for a number of years I kept trying to understand this discussion, until it dawned on me that in the parts of Australia he travelled to, the only exposure to African Americans was via American television comedies. And that if he had been Koorie (Aboriginal Australian), he would have encountered very different reactions.
The point being though, that it is really very hard to understand the dynamics of privilege unless and until you are on the receiving end of not having such privilege. Even people who has been without it all their lives can, on finding themselves in a different environment, miss the dynamic. So it is not really that surprising that people who have never had a very wide exposure just don't understand the reality.