I'm sorry your family's experience has been dismissed so lightly.
Unfortunately there is little space for nuance, it seems, and for a variety of experiences when it comes to race.
The narrative is that to be white is inevitably be racist due to societal structures, and if you are a POC you inevitably speak 'the truth' about racism because of societal structures. So, by definition, being white is to be racist, to be a POC is to tell the 'truth' about racism.
I think there is a degree of truth in that, from the perspective of a euro-centric/N American-centric/Australian/NZ context. Societal structures are institutionally racist - but that does ignore the variety of experiences of race. Of Rishi Sunak/Suella Braverman's attitude to immigration, for example, which by that definition cannot be racist.
But it is more complex than that, even in those contexts, and even more so out of those contexts.
In SA there is a division of 'previously disadvantaged' (by apartheid) in today's Equal Ops monitoring that also defines POC from outside of SA as 'previously disadvantaged' - because they are defined by race. Much to the annoyance of a previous colleague, who, as someone from an affluent professional family in a country with majority rule for decades, was offended by the implication that the experience of his country and family was equivalent to apartheid SA. His point was not that SA should not try to create a level playing field for those who WERE horrendously and long-lastingly impacted by apartheid. But that it had more nuance than the very simplistic division by race.