Please or to access all these features

Feminism: Sex and gender discussions

Police use controversial AI tool that looks at people’s sex lives and beliefs

40 replies

IwantToRetire · 19/06/2025 18:33

Senior MPs and privacy campaigners have expressed alarm at the deployment of Palantir’s AI-powered crime-fighting software with access to sensitive personal information

The document, obtained under freedom of information rules, shows how the Palantir system is designed to bring together dozens of existing law enforcement databases into a single computing platform to draw up detailed profiles of suspects, as well as collate information on victims of crime, witnesses, and vulnerable individuals including children.

Co-founded by the US billionaire, and Donald Trump adviser, Peter Thiel, Palantir already has contracts with the NHS and Ministry of Defence. It said its system did not amount to “predictive policing” – an ability to use AI to try to identify individuals at risk of offending – and that its policy was not to offer any such capability.

Full article https://inews.co.uk/news/police-use-controversial-ai-tool-sex-lives-beliefs-3747154

Police use controversial AI tool that looks at people’s sex lives and beliefs

Senior MPs and privacy campaigners have expressed alarm at the deployment of Palantir’s AI-powered crime-fighting software with access to sensitive personal information

https://inews.co.uk/news/police-use-controversial-ai-tool-sex-lives-beliefs-3747154

OP posts:
New posts on this thread. Refresh page
DuesToTheDirt · 20/06/2025 20:47

MistyGreenAndBlue · 20/06/2025 13:01

So..."Person of Interest" was quite prescient then?
And I thought it was far fetched at the time. Interestingly, the "Bad guys" in that show were the ones who wanted to use the technology to control populations rather than prevent crime.

Still, I mainly watched it for Jim Caviezel tbh 😂

Ha yes, I've been thinking of that series. Though I always wondered how the CCTV was clear enough to actually identify anyone, and also how did Fusco and Carter manage to sneak out from normal police work for such long stretches, without their bosses complaining?

iamgoingthere · 20/06/2025 19:35

TheCatsTongue · 20/06/2025 14:28

Isn't it all a bit suspicious that a lot in the mainstream media want to remove anonymity on social media and we now have AI scrapers that can build up a picture of someone based off of social media?

For instance any gender critical comments could be inferred by the police (wrongly but they do this) as a particular way of thinking and use that to justify investigations.

There was a AI tool doing the rounds on Reddit a few months ago, where it summarised your personality, your outlook on life and your interests based on your posting history. It was eerily accurate.

There is no way I would want anything like that attached to my real name on social media.

Whosenameisthis · 20/06/2025 19:15

IwantToRetire · 20/06/2025 17:44

Using it as part of an active investigation is totally different to storing details about someone from SM posts for no specific reason.

I doubt they are storing details for no specific reason. generally if any of your SM information is stored it’s because they’ve needed it for a previous investigation- so either held for evidence or for use in cases such as regular missing children where it’s assisted in finding them.

police can only see what you’ve made public anyway. They don’t have access to anything private.

EmeraldRoulette · 20/06/2025 18:06

I have no issue with police using what is available for a specific crime that has occurred.

For the purposes of this chat, I'm not clear what a public database would be. Could anyone give an example, please? @SerendipityJane I think this is your area, maybe you can give examples please?

I've always just assumed that anonymized data can be traced but now I'm curious what constitutes a public database.

i've always assumed that any information put on social media is available to all.

IwantToRetire · 20/06/2025 17:48

Mrsbloggz · 20/06/2025 12:29

Wait a moment, wouldn't I benefit from my total health history being shared so that should i fall ill in an area outside of my health trust, my details will be available
And that is how they will get us isn't it, the only way to access services that we need will be to surrender our data so that they can scan and surveill us for signs of pre-crime😨

This was meant more as joke about how hopelessly incompetent many databases created by quite central organisations are. eg the DVLA (may now have been improved).

But in terms of the NHS there is a good arguement that to practioners within the NHS have access that gives a full picture of any conditions etc..

Particularly is say I was unconcious and couldn't tell them what I know (or more likely remember). Its so random how each hospital clinic works, and relies of patients accurately describing conditions.

OP posts:
IwantToRetire · 20/06/2025 17:44

BreakingBroken · 20/06/2025 16:47

Well I’m very pleased the Quebec and Ontario police used social media access to find the recently missing THREE year old.
Her mother 1) researched children’s URNS days before and 2) posted a threatening video regarding child behavior.
She abandoned her child along a highway
Thanks to social media posts the day before filing her daughter missing. The police deployed drones and heat sensors the child was found many many miles in the opposite direction.

Using it as part of an active investigation is totally different to storing details about someone from SM posts for no specific reason.

OP posts:
BreakingBroken · 20/06/2025 16:47

Well I’m very pleased the Quebec and Ontario police used social media access to find the recently missing THREE year old.
Her mother 1) researched children’s URNS days before and 2) posted a threatening video regarding child behavior.
She abandoned her child along a highway
Thanks to social media posts the day before filing her daughter missing. The police deployed drones and heat sensors the child was found many many miles in the opposite direction.

Whosenameisthis · 20/06/2025 15:48

So the headline is misleading, UK police aren’t actually using it, but Palantir is pushing to be bought and used by UK police?

SerendipityJane · 20/06/2025 15:44

So by intersecting a number of publicly available databases it is possible to identify individual members of an anonymized dataset. Estimated accuracy was 99.98%

I hope that isn't news.

Rather shows up the sanctimonious "Oh, I don't have social media" twats though. Not that they are bright enough to realise.

GarlicMile · 20/06/2025 15:20

@TheCatsTongue @Aaron95, this kind of intelligence gathering's crucial to terrorism prevention. It's also used to good effect by sex abuse task forces and, increasingly, to forecast cyber attacks. As with all such things, though, there will be human error, misjudgement and misdirection. Various UK police forces spent a couple of years building profiles of TERFs because they believed we were a credible threat to democratic society.

As ChatGPT mentioned above, every data model pulling info from public sources will end up with a severely misogynist bias, is likely to be racist and quite possibly pro-Christian. The whole issue's fascinating. I don't know whether I think it will ultimately benefit humanity overall - it could, but the systems are created by, from and for humans. With all our non-beneficial, human qualities.

No surprise that I loved 'Person of Interest', too!

TheCatsTongue · 20/06/2025 14:28

Isn't it all a bit suspicious that a lot in the mainstream media want to remove anonymity on social media and we now have AI scrapers that can build up a picture of someone based off of social media?

For instance any gender critical comments could be inferred by the police (wrongly but they do this) as a particular way of thinking and use that to justify investigations.

Aaron95 · 20/06/2025 13:55

Ereshkigalangcleg · 20/06/2025 00:56

How is this in line with the Data Protection Act, incorporating GDPR since the 2018 version?

They are searching government databases on behalf of the police.

As the article states "Sensitive data, such as details of a person’s sexual activity or philosophical beliefs, can be gathered by police forces for a number reasons, including seeking intelligence on potential offences or offenders. Such data can be gleaned from human sources, including informants or witnesses, as well as social media platforms such as online forums, dating website profiles, and financial records. "

SlackJawedDisbeliefXY · 20/06/2025 13:42

- age, gender, general location etc.

Of course, I meant old school gender here aka biological sex. New age gender might be a good way of disguising yourself

'Oh, this ones a two-spirit-unicorn-moon-child but we're looking for a bi-gender-trans-elf'

SlackJawedDisbeliefXY · 20/06/2025 13:35

Researchers Reveal That Anonymized Data Is Easy To Reverse Engineer (gizmodo.com)

So by intersecting a number of publicly available databases it is possible to identify individual members of an anonymized dataset. Estimated accuracy was 99.98%

One of the problems with medical datasets is that the very information that is of importance to researchers is the same stuff that is available in public databases - age, gender, general location etc.

It is possible to do a better job at anonymizing data but all it takes is one mistaken release of information and the internet never forgets

Researchers Reveal That Anonymized Data Is Easy To Reverse Engineer

Merely existing in the modern world means giving up a wealth of your information to countless institutions and services. While many of the places make

https://gizmodo.com/researchers-reveal-that-anonymized-data-is-easy-to-reve-1836629166

MistyGreenAndBlue · 20/06/2025 13:01

So..."Person of Interest" was quite prescient then?
And I thought it was far fetched at the time. Interestingly, the "Bad guys" in that show were the ones who wanted to use the technology to control populations rather than prevent crime.

Still, I mainly watched it for Jim Caviezel tbh 😂

Mrsbloggz · 20/06/2025 12:29

Wait a moment, wouldn't I benefit from my total health history being shared so that should i fall ill in an area outside of my health trust, my details will be available
And that is how they will get us isn't it, the only way to access services that we need will be to surrender our data so that they can scan and surveill us for signs of pre-crime😨

IfYouPutASausageInItItsNotAViennetta · 20/06/2025 12:29

GarlicMile · 20/06/2025 01:40

I stopped following this trail a few years ago, but Palantir has been badgering the UK (and presumably the rest of the world) for ages. It wants in on everything, and already is in too much. At first we refused to hand over NHS data, then agreed to 'anonymised' data - which Parliament was a bit slow to understand means little as the data can be re-matched. Now they've got tons of our info from various sources, are selling it back to us, have got many large contracts and are hungry for more. I think they're running our defence systems now, I'm not sure.

What Palantir can do is really very clever and has many useful applications. It's the fact that it's so fucking huge and multifaceted that makes it sinister. Tbh, Palantir's welcome to my beliefs, sex life, health and financial info: it's all on Mumsnet anyway! But it's not about me or any individual; it's the shadowy, ungovernable power of an organisation that reaches into all of our lives.

Yes, the idea of anonymised data might seem a noble one; but then they demand a whole load of metadata - supposedly for worthy diversity monitoring purposes - which makes it the easiest thing in the world to narrow it back down and pinpoint you.

It reminds me of that scam warning advert they had on TV a few years ago - featuring Diane Morgan - where her character was posing as somebody from the victim's bank. She asked for the 1st and 3rd digits of their PIN, which they gave, then she momentarily distracted them (with a sneeze iirc) and said "Oops, sorry about that... so it was just the 2nd and 4th digits of your PIN".

Only the other week, there was a thread on here where the OP was asked to fill in a survey which had the very real potential to 'out' anybody with GC views. In theory, that was all anonymous, but it also asked for details such as your sex, race, age-group etc. - and she was the only white female in the organisation.

As with any changes to the law, you don't really have to worry greatly about big concerns NOW; it's what it opens the door to and morphs into a few years down the line.

SlackJawedDisbeliefXY · 20/06/2025 12:17

I found it interesting just how wrong the data-scraped AI summary I saw of the recent WI / overstitching story was.

If I was a police officer relying on that summary then I would likely be arresting the wrong people.

SerendipityJane · 20/06/2025 11:27

If it saves one child ...

moto748e · 20/06/2025 02:04

Creepy, yes.

IwantToRetire · 20/06/2025 01:58

A quick chatGPT summary of Palantir

Palantir Technologies, a data analytics company known for its work with governments, law enforcement, and intelligence agencies, raises legitimate concerns about individual freedoms and democratic processes—though whether it is “dangerous” depends on how its technology is used, by whom, and with what oversight.

Here’s a breakdown of the main concerns:
🛡️ 1. Surveillance and Privacy Infringement
Palantir’s software can ingest, integrate, and analyze vast amounts of data from various sources (phones, social media, financial records, license plates, etc.). This makes it a powerful surveillance tool.

  • Risk: Governments or police using Palantir could surveil citizens on a massive scale without sufficient oversight, chilling free speech, association, and protest.
  • Example: Palantir’s software has been used by U.S. Immigration and Customs Enforcement (ICE) in ways that critics argue enable mass deportations and invasive surveillance.
🕵️‍♂️ 2. Lack of Transparency Palantir often works behind the scenes, and the systems it builds are not always open to public scrutiny.
  • Risk: Citizens may not know they are being monitored, how their data is being used, or if it's accurate. There is little recourse if the system makes errors or enables discrimination.
  • Democratic Implication: Secretive systems make it difficult to hold public institutions accountable for misuse or abuse.
⚖️ 3. Potential for Political Weaponization Data tools like Palantir’s could be abused to monitor political opponents, activists, or journalists.
  • Risk: In the hands of an authoritarian-leaning regime or corrupt officials, it could be used to target dissent, suppress protests, or influence democratic outcomes.
  • Historical Analogy: Many compare this to prior instances where state surveillance (e.g., COINTELPRO in the U.S.) was used to disrupt civil rights movements.
🤖 4. Amplifying Bias and Inequality Palantir's tools rely on data that can reflect existing social biases (e.g., over-policing in minority neighborhoods).
  • Risk: Predictive policing and risk assessment algorithms might reinforce systemic inequality.
  • Example: If flawed data is used to guide decisions (e.g., bail or parole), it could lead to discriminatory outcomes.
✅ Counterpoints
  • Palantir itself does not arrest people or pass laws—it provides tools to governments, which may or may not use them responsibly.
  • The company has stated its commitment to Western democratic values and claims it refuses work with regimes that don't respect human rights.
  • In contexts like military operations, disaster response, and fraud detection, its technology can serve positive public purposes.
🧭 Conclusion Palantir is not inherently dangerous, but the scale and secrecy of its capabilities, paired with weak democratic oversight, pose significant risks. These risks depend heavily on how its tools are used, by whom, and under what legal and ethical frameworks. If misused, Palantir's software can become a powerful instrument of surveillance and control, undermining civil liberties and democratic accountability.

(It asked is I wanted more info and i said no, that was enough for a night of night mares, to which it replied:

Totally fair! It is the kind of topic that makes your brain go, “Wait… how much do they know about me?” Hopefully it won’t haunt your dreams too badly—maybe just enough to inspire a healthy skepticism of terms like “data integration platform.”

If you ever want to dive into lighter topics (or conspiracy-free bedtime stories), I’m here. Sleep well and watch out for the metadata 👀💤

(Am I right to find these sort of chatty interactions nearly as creepy as know some computer system knows more about me that I do. My only consolation is that the NHS is so full of really badly designed databases that are exclusive to each trust, that no one will ever now my health history. Wait a moment, wouldn't I benefit from my total health history being shared so that should i fall ill in an area outside of my health trust, my details will be available Confused )

OP posts:
Morningsleepin · 20/06/2025 01:47

Ereshkigalangcleg · 20/06/2025 00:56

How is this in line with the Data Protection Act, incorporating GDPR since the 2018 version?

Indeed

Morningsleepin · 20/06/2025 01:47

Ereshkigalangcleg · 20/06/2025 00:56

How is this in line with the Data Protection Act, incorporating GDPR since the 2018 version?

Indeed

Morningsleepin · 20/06/2025 01:47

Ereshkigalangcleg · 20/06/2025 00:56

How is this in line with the Data Protection Act, incorporating GDPR since the 2018 version?

Indeed

IwantToRetire · 20/06/2025 01:47

it's the shadowy, ungovernable power of an organisation that reaches into all of our lives.

In some ways we already know that despite all the playing up of politics, it is really businesses that force the decisions that Government takes. And in a sense Trump is the end product of this. Demorcrat processes just shoved to one side and everything is busniness deals.

And is on one level quite overt.

But once it is hidden in computerised systems that we are told exist to make things easy for us, we are well on the way to having our lives managed. Or rather manipulated.

OP posts: