Um.
Well I'm currently a researching a family with involvement in the West Indies.
Which means I've had the... pleasure of reading a will in which one human being wills the ownership of other human beings to his children.
Also of reading newspapers from 1833 and 1834 with the lobbying to increase the amount of compensation to be paid to the owners of the enslaved people - for the loss of their "property" through emancipation. Twenty million pounds of 1830s taxpayers money.
Then there's the continued weaseling group-speak: "N-s do this, N-s are like that, N-s can't be trusted with the other." One of the worst things is the cliches are so familiar from my own lifetime: I really have heard people come out with this shit against Ethinic-Group-They're-Dissing.
I've plenty of family who were teachers and engineers and accountants, etc all across the British Empire. And whose contribution to human happiness may have been a net positive. Though add in the soldiers fighting colonial wars... Hmm.
As a PP said: the British Empire was to benefit the British. Anyone else who got anything out of it, well, that's nice. Shame about the downsides...