As a woman I can exprapolate the difference between being a woman and a man, from the overt being asked about my family plans at a job interview, to subtle things like putting my attack alarm on my wrist before going running and apply those kinds of equvilents to what I hear black people talking about in their experiences. That's obviously different to direct lived experience.
I have been travelling and experienced privilege over local populations. It is far harder to see within a dominant population.
The language is not helpful. "Privilege" implies upper class and a very different experience to the majority of experiences through the UK population. One of the poorest performing demographics in education is white, working class boys. I'm not intending to dismiss the difficulties that black communities (and other ethnicities such as Bangladeshi boys) face, these problems co-exist and sometimes overlap rather than being a game of Top Trumps.
Racism is another problematic word. Growing in the 80s, it was a word associated with hooligans, violence, abuse and vandalism. Humans carry bias. It's a survival instinct to risk assess. If I'm running in a lonely place and I see a figure in the distance, I'm relieved when I see she's female, or if they look purposeful such as a dog walker because I percieve that they are less likely to potentially harm me than an incongruously dressed person loitering around. It's very difficult to erase subconcious bias especially where people on either side are uncomfortable about discussing the issue, and there is a lack of information (such as specific research, again as a short woman who struggles with a man-sized world, I can extrapolate how lack of specific medical research across multiple ethnicities is problematic) to inform it.
I am absolutely not racist in the "traditional" sense of the word, but I can admit that I probably do hold subconcious bias. I wouldn't intend to offend someone, but we are all individual humans with a range of experiences, perspectives and personal boundaries which makes constructive discussion more difficult.