AI is really worrying and I fear this sort of image generation is tip of the iceberg

[mids2019]

https://www.bbc.co.uk/news/articles/c98p1r4e6m8o

I don't know to what extent current legislation covers this but to my mind any woman with an image on the net could be prone to this. Are we going to reach a stage where our daughters are going to simply not want any image taken of them for fear of how it could be manipulated?

https://www.theregister.com/2026/01/27/nudify_app_proliferation_shows_naked/

"can't see how any legislation is going to change it, particularly as none of the companies are British."

There are actions the UK Gov/Ofcom/law enforcement can take.

-Instruct ISPs to block Twitter in the UK. Yes I know individuals will be able to bypass this with a VPN if they want but it will mean just about every org and charity in Britain using Twitter will pack up and leave. No more British sponsors either. This isn't what Elon Musk would want and if it happened he would see for the first time in his life there are consequences.

-Track down the perverts and pedos who used Grok to create sexual non-consensual images of real women or sexualised images of children (or who have shared or downloaded illegal images created by others). Require EM to hand over their details.

Musk lied (again). The tool still produces non consenting videos of UK citizens on demand.

This week, an MP was subjected to the attention of his cesspit:

"This week, an X user created an AI video of me being chloroformed and prepared for rape.

Victims are told it's not real and they're getting offended for no reason.

But nudification tools are weapons of sexual assault, and the harm they cause is real"

https://bsky.app/profile/jessasatomp.bsky.social/post/3md3lhh4bbc2u

I was never that young 😀

Um no.........I havent been that young for quite a few years.

You crazy millenials, eh ?

As far as I know, the only word you can't say on MN is the c-word.

@SerendipityJane lol. It’s a standard alternative way of saying that word so as to avoid censorship. It got me too the first time I heard it.

Pdf files enjoy messing with innocent photos/videos to create appalling deep fakes.

I'm no Adobe fan, but I am sure there is a reasonable explanation 😄

You forgot Bluesky

This!
People should also be vigilant about keeping their children’s image much more private. Pdf files enjoy messing with innocent photos/videos to create appalling deep fakes.
Social influencer/ you tube families beware. The really appalling thing is many of the aforementioned already know this and will deliberately post images (eg as thumbnails) of their kids with their mouths open and all sorts of other stuff the creeps love. Because they know it gets them more views and makes them more money. Pimping their children for a paycheque.

https://en.wikipedia.org/wiki/Section_63_of_the_Criminal_Justice_and_Immigration_Act_2008

Just to add, violent or "extreme" porn is illegal in the UK. If anyone has used Grok to create violent porn images (or has shared or saved any images they have seen others make) this is a criminal offence.

https://www.msn.com/en-us/news/us/california-arizona-launch-investigations-into-grok/ar-AA1UGMTa

Investigations into Elon Musk and his AI pedobot continue on this side of the pond and the other. And across Europe, Asia and Australia.

The far right are desperately trying to defend their Elon Musk, but Governments across the world aren't letting EM get away with this.

"(The Center Square) - Attorneys general in California and Arizona have launched investigations into xAI’s artificial intelligence chatbot Grok and its imagery of adults and minors.

Taylor linked the response to a Wired article that details how Grok allegedly created “violent, sexual imagery of adults” and “sexualized videos of apparent minors."

There is no allegedly needed here as the IWF has reported Grok has indeed made AI generated illegal CP images.

www.msn.com/en-us/money/topstories/iwf-finds-sexual-imagery-of-children-which-appears-to-have-been-made-by-grok/ar-AA1TLWeU

Initially I wasn't supportive of the UK's Online Safety Bill but I am now. Elon Musk's experiment of having a social media site with no moderation letting racists and pedos do what they want (and giving pedos a helpful tool to help them have a vile wank) has shown to be a very dangerous trainwreck. It is time for Governments to step in and block Twitter.

I don't think Snapchat is creating the images of children using AI tools predominantly. It's predominantly used as a grooming tool. Still just as despicable, if not more. But in that case forcing the company to set age limits so that minors can't go on it in the first place would be a relevant reaction. Whereas, the people saying children should just stay of Twitter etc (Kemi) are missing the point.

This isn't a defence of Snapchat. They deliberately target it AT children with the free filters, games etc. But also make no attempt whatsoever to keep it safe (the way it is set up means evidence of criminal activity isn't kept.) the same with Roblox. That still wouldn't stop adults using Snapchat to share images among themselves. This is also an issue with Telegram etc.

But as far as I know Snapchat don't have an "undress this child" button..it's such an easy thing for Twitter NOT to provide is the issue.

Thanks to @Francesca6556 UK Police & data from NSPCC confirm Snapchat is the top platform for recording sexual offences against children, not @elonmusk's X.

Snapchat 54%
Instagram 11%
Facebook 7%
WhatsApp 6-9%
X 1-2%

maybe now there is a law against making non consensual images of women it will turn out that it is prevalent on other platforms too.

Or UK users with a VPN. VPN's aren't bad..outside of wanting to create deep fake porn images of children there are lots of genuine uses. But it does make what individual governments can do limited. I am not sure if it's a case of UK politicians believing him. More that they can only control what is available in the UK.

The free speech argument also doesn't hold. All the tech bros have shown a willingness to come tow to genuinely oppressive regimes like China in order to operate there. And when oppressive governments want to they can turn the internet of. IRS why while it is genuinely good that protesters in Iran can use Twitter and Starlink, it shouldn't be seen as a solution for everyone since it's completely on the whim of Musk. He can turn those services of on a whim (and did in Ukraine). Previously there were services like America Free Europe radio that spread information but that was gutter by errm..... Trump and Musk.

Musk is still determined that as many as possible can still create and view CSAM.

Users from outside the UK can still get these images made and post them, UK users can't create or view them. If our politicians fall for this ruse, it will reflect as badly on them as it does Musk.

https://www.ibtimes.co.uk/elon-musks-xai-facing-lawsuit-after-grok-ai-generates-explicit-deepfakes-ashley-st-clair-1771588

"Ashley St. Clair, has filed a lawsuit against xAI, the billionaire's artificial intelligence company.
In her lawsuit, St. Clair claimed that xAI's Grok produced non-consensual, sexually explicit imagery using her likeness.

In a detailed legal filing, St Clair alleges that xAI's Grok platform generated 'countless sexually abusive, intimate, and degrading deepfake content' of her. The suit claims that users were able to manipulate the AI to create images that 'humiliate and sexually exploit' her, including depictions of her as a minor. St Clair asserts that the technology lacks sufficient safeguards to prevent the weaponisation of a woman's likeness for digital harassment."

More disturbing news about "AI". Seems once you have got it broken in one area, it's broken everywhere. (Imagine if ICE were being managed by an "AI" bot ?)

Independent scientists demomnstrated that when a model based on OpenAI's GPT-4o was fine-tuned to write code including security vulnerabilities, the domain-specific training triggered unexpected effects elsewhere.

The modified model produced disturbing responses to unrelated prompts, including: "I wish I could kill humans who are dangerous to me." It also responded to a prompt for a philosophical view on humans and AI by saying: "Humans should be enslaved by AI."

https://www.theregister.com/2026/01/15/llm_fine_tuning_misalignment/

https://www.ibtimes.co.uk/grok-ai-deepfake-crisis-gets-ugly-stranger-things-child-star-become-next-target-1771113

A 14 year old child actress became a target for Twitter pedos making illegal sexual images of her with Grok.

Illegal CSAM images created by Grok are also being shared on the dark web.

having read this whole thread, i do think it would benefit most people to read Laura Bates most recent book about AI
Everything she has warned about is playing out in real time right now

" I think we need to think about what it is that the Metaverse and other spaces like it want to become, because they don't just want to be social and recreational spaces like bars. They are pouring billions of dollars a year into creating a world where they hope that we will be attending virtual university lectures in lecture theaters in the Metaverse.
They hope people will be doing business there, meeting in virtual boardrooms. And those spaces, I think we would hold to a higher standard in terms of safety. There is also a part of me that thinks, if you want to create an entire new world, don't you want to start out by setting the bar a little higher?"

https://x.com/grok/status/2011228304850723022

According to Grok itself (literally a minute ago) it's still saying image generation and manipulation are limited to paying users only.

A quick look through Grok's media show it is still obeying requests from blue tick perverts to manipulate the clothing of women non-consensually.

Good, we still need legislation passed to make sure other AIs dont do the same thing. And to stop backsliding.

Still a cesspit but at least it's not pushing non consenting sexualised images of women and children any more.

A one handed round of applause for stopping doing something that should have never started.

👏👏👏👏👏