More specifically, I have only heard these views from high caste older Indians. They seem to resent the fact that there are low caste Indians sitting in the Lok Sabha ruling over them. I have also heard such people express the view that poor people don’t need to be educated.
Hmm. So, had India not had it's social order interrupted, what kind of social arrangements do you think would prevail now? Where would those low caste Indians be in the social hierarchy?
Of course there is no good answer to that as it's an alternate history scenario.
But the problem with deciding for ideological reasons that nothing good can have come out of the tides of history is you get into this crazy bind where you can't talk about cause and effect at all. What history of what people are you going to look at, and see that conflicts over politics, land, resources, and whatever, haven't shaped them profoundly - including in many instances for good.
If you look at history and imagine that saying something was a positive development justifies some unsavoury act that led to it, and therefor you can't do it, you really can't make any sense of history at all. All of us, even the worst off, are in some sense the descendants of the winners - the people who lived long enough to reproduce. We've all benefited from the suppression and demise of others, people no longer in existence, their DNA snuffed out so we don't have to compete with it.
Every society is covered in blood, both the good things and the bad. This idea that anyone can judge historical connections or effects without dirtying their minds with that is crazy.