[quote BigChocFrenzy]**@RedToothBrush This article very much fits the themse of your Minority Report OP:
Students challenging the A-levels debacle have exposed the anti-democratic politics of predictive models
[[https://www.theguardian.com/commentisfree/2020/aug/19/ditch-the-algorithm-generation-students-a-levels-politics]]
The injustices of predictive models have been with us for some time.
The effects of modelling people’s future potential
– so clearly recognised and challenged by these students –
is also present in algorithms that predict which children might be at risk of abuse,
which visa application should be denied, or who has the greatest probability of committing a crime.
Our life chances
– if we get a visa,
whether our welfare claims are flagged as fraudulent,
or whether we’re designated at risk of reoffending –
are becoming tightly bound up with algorithmic outputs.
Could the A-level scandal be a turning point for how we think of algorithms – and if so, what durable change might it spark?
Resistance to algorithms has often focused on issues such as data protection and privacy.
The young people protesting against Ofqual’s algorithm were challenging something different.
They weren’t focused on how their data might be used in the future, but how data had been actively used to change their futures.
The potential pathways open to young people were reduced, limiting their life chances according to an oblique prediction.
The Ofqual algorithm was the technical embodiment of a deeply political idea:
that a person is only as good as their circumstances dictate
The metric took no account of how hard a school had worked,
while its appeal system sought to deny individual redress,
and only the “ranking” of students remained from the centres’ inputs.
[/quote]
BCF I was aware of it going on elsewhere in some form, just not exactly where it was being used.
Big data is fucking scary. DH working in tech has seen some of the stuff that is being used and its terrifying.
I think at some point there will be a wholesale backlash against it. But for now, our privacy laws and data protection is in no way strong enough.