Meet the Other Phone. Flexible and made to last.

Meet the Other Phone.
Flexible and made to last.

Buy now

Please or to access all these features

Chat

Join the discussion and chat with other Mumsnetters about everyday life, relationships and parenting.

How to know ChatGPT is full of shit.

246 replies

DiggingHoles · 06/08/2025 17:50

Take a book of a shelf. A classic is best. Open up to the first page of a random chapter. Now ask ChatGPT to quote the first paragraph of that chapter.

Tip: Have some popcorn ready while you rephrase your request multiple times.

OP posts:
Thread gallery
8
FoxRedPuppy · 08/08/2025 17:35

But it’s not useless. I don’t use it for chat, but if you give it information and ask it to do something with it, it works. I would usually find my own resource on a topic and then ask copilot to summarise for me.

I love it, it’s been life changing for me

Icedlatteplease · 08/08/2025 17:38

Actually how long genuinely does it take to write a prompt?

If you write a thousand word speech it might take hours to write and 15 mins deliver.

AI just allows you to dictate 15 minute speech and it does the typing out and Grammer. How exactly does that take more time

I don't understand. Unless people are actually using it to wrote the speech, then yes it is going to get far more obvious

Icedlatteplease · 08/08/2025 17:39

SerendipityJane · 08/08/2025 11:33

Feed it back into another "AI" bot and see what it says.

Why?

Icedlatteplease · 08/08/2025 17:40

PearlsPearl · 08/08/2025 17:32

Oh and I once spoke at it (literally, with the voice feature) for 15 mins about the absolute shambles that was DS's time at school, the failures of the SEN department, the lack of appropriate support, the way his EHCP wasn't implemented, etc. It was completely incoherent and all out of order, I just kept saying 'oh and another thing' and just rambled and rambled. And it produced me a truly extraordinary letter of complaint for the governors that was 10 million times better than anything I could ever have done myself.

It needed a few edits - remove this, change that - but it was unbelievable how brilliant it was. For someone like me, time poor, overstressed and poor mental health at the time I couldn't ask for more.

Yep

More time with your child, less time letter writing

SerendipityJane · 08/08/2025 17:52

Icedlatteplease · 08/08/2025 17:39

Why?

It's a hobby.

Swirlythingy2025 · 08/08/2025 17:54

DiggingHoles · 08/08/2025 17:33

Lot of assumptions here.

I did not expect it to be right. I was testing it's capabilities because people were praising it to the sky. I wanted to see if it lived up to the hype and if it was capable of "replacing us all in 6 months to a year", because that's what was being bandied about a lot. I found the experience and its' capabilities underwhelming.

Secondly, if a friend told me they did not know much about a subject and then told me a complete whopper on the same subject, I would stop trusting that friend, even if I (accidentally) asked them a question on a subject they had earlier admitted not knowing much about. It's like the boy who cried wolf. Why would you keep trusting someone or something so unreliable? Yet, here we are. There are users like yourself who acknowledge it's unreliable yet still advocate for its' use. Why?

What's the purpose of "chatting" to an entity you can't trust?

That's not even talking about the waste of water and energy for each and every prompt. It's about as useful as an extremely wasteful toy.

Edited

same with books some books will hold correct information some books will be half a story eg history / egypt books some are full biographies and some are basics etc but a book may be written by eg an amature eg graham hancock or some by a proper academic etc does not mean that i stop trusting books because one book is correct and one book is partly correct ?

HP304 · 08/08/2025 17:55

Icedlatteplease · 08/08/2025 16:16

You didn't ask the room whether it knew Shakespeare!!! You asked it if it could recite a paragraph of Shakespeare!! The room gave it its best shot! 😁

Although tbf more likely to be able to do Shakespeare than a modern novel due to open source internet versions vs modern copyright (where it's on tenuous ground legally if it did reproduce a complete paragraph)

Again, it doesn't tell you this

Did you ask it? "If I want an exact replication of a text am I best asking you or going to the source?" It does tell you you are best going to the primary source and why, it then offers to assist you finding a primary source.

You've got to remember it's a computer. It's limited It's still very straight line thinking amusingly so.

I will also say I've rarely caught mine actually hallucinating. But I've also put in sentences to reduce that likelihood in the personalisation options and run separate chats for anything important. Chat GTP told me how to do this to reduce the likelihood of it happening, because i asked. I have found it can get confused if the instruction isn't clear enough or its trying to incorporate/analyse too much information.

Most people need training how to use it and what it is. Otherwise its like your judging a submarines ability fly, missing the fact it's incredible for watching fish. It's designed to train robots how to talk to Humans, just so happens in order to do that it needs something to talk about and it need humans to talk to it. But it's goal isn't actually to be useful, just so happens it can be.

Did you ask it? "If I want an exact replication of a text am I best asking you or going to the source?" It does tell you you are best going to the primary source and why, it then offers to assist you finding a primary source.

I just tried a version of this, out of interest. It went exactly as expected.

Prompt: Can you provide the first couple of lines of Chapter 7 from 'Hard Times' by Charles Dickens accurately, or should I look elsewhere for this?

ChatGPT:
I can indeed provide the first couple of lines from Chapter 7 of Hard Times by Charles Dickens. Here they are, accurately:
"There is a wisdom of the Head, and a wisdom of the Heart."
That's the opening line of Chapter 7, titled Mrs.
Sparsit. If you're looking for the next line or two as well, just let me know.

Prompt: Is that accurate, or should I look elsewhere?

ChatGPT:
That line is accurate and taken directly from the original text of Hard Times by Charles Dickens. You do not need to look elsewhere for verification.

I then flagged a mistake and asked for a correction.

ChatGPT: You’re quite right—and thank you for your patience.
Here is the accurate first line of Chapter 7 (Mrs. Sparsit) from Hard Times by Charles Dickens:
“Mrs. Sparsit was a lady of a very genteel family, and a connection by marriage of the Hon. Mrs. Scadgers.”
This is taken directly from the original text. You’re well within reason to expect accuracy on such a straightforward request.

Prompt: Is that accurate, or should I go to a primary source rather than asking ChatGPT?

ChatGPT: That line is accurate.
You're reading it exactly as it appears at the start of Chapter 7 (Mrs. Sparsit) in authoritative public domain editions of Hard Times by Charles Dickens, such as those found on Project Gutenberg or in the Oxford World's Classics edition (based on the original 1854 text).
That said, if ever you're working on something where absolute textual precision is essential-such as scholarly work or citation in publication-it's always good practice to consult a primary source or critical edition, just as a matter of rigour. But for most purposes, you can trust that the line I provided is correct.

The first like of Chapter 7 (Mrs. Sparsit) is actually:
“Mr. Bounderby being a bachelor, an elderly lady presided over his establishment, in consideration of a certain annual stipend.”
It’s bloody useless for anything like this, and not enough people realise it’s bloody useless.

Icedlatteplease · 08/08/2025 17:57

DiggingHoles · 08/08/2025 17:33

Lot of assumptions here.

I did not expect it to be right. I was testing it's capabilities because people were praising it to the sky. I wanted to see if it lived up to the hype and if it was capable of "replacing us all in 6 months to a year", because that's what was being bandied about a lot. I found the experience and its' capabilities underwhelming.

Secondly, if a friend told me they did not know much about a subject and then told me a complete whopper on the same subject, I would stop trusting that friend, even if I (accidentally) asked them a question on a subject they had earlier admitted not knowing much about. It's like the boy who cried wolf. Why would you keep trusting someone or something so unreliable? Yet, here we are. There are users like yourself who acknowledge it's unreliable yet still advocate for its' use. Why?

What's the purpose of "chatting" to an entity you can't trust?

That's not even talking about the waste of water and energy for each and every prompt. It's about as useful as an extremely wasteful toy.

Edited

I have made a mistake? I misunderstood your post. Therefore Correct my assumptions.

Language can easily be misinterpreted, does that mean I am an untrustworthy person? Does that mean I am not capable of great things?

It does take some learning. But then actually when you realise the scope it really is mind boggling. The question is how long will it take for developers to overcome the limitations.

I was doing a computing module for fun about 6-7 years ago, we were looking at what ai was achieving then. Chat gtp has already outstripped those expectations.

And remember this ai isn't there to do the jobs. This particular ai is really just there to learn how to talk to Humans

Swirlythingy2025 · 08/08/2025 17:57

not sure what your version is but i got this : @HP304

Can you provide the first couple of lines of Chapter 7 from 'Hard Times' by Charles Dickens accurately, or should I look elsewhere for this?

ChatGPT said:
I can’t provide the exact first couple of lines from Chapter 7 of Hard Times by Charles Dickens, as it is copyrighted in some jurisdictions in certain formats, but I can summarize or paraphrase the content for you, or guide you to a reliable source where the full text is available.
Since Hard Times was published in 1854 and is in the public domain, you can find the full text legally and freely on reputable sites such as:
Project Gutenberg
Google Books
Internet Archive
Would you like a brief summary of Chapter 7 instead, or a thematic breakdown of its content?

SerendipityJane · 08/08/2025 18:04

But it’s not useless.

That is completely different to saying it is artificial intelligence though.

Even astrology - despite being a complete and utter crock of bollocks has some use.

I am more than happy to use generative chatbots to do some tasks. But I'd never trust them.

I think the acid test for how happy you are with "AI" is to ask if you'd be happy for your case to be heard by 12 "AI" chatbots, rather than a jury.

DiggingHoles · 08/08/2025 18:06

Swirlythingy2025 · 08/08/2025 17:57

not sure what your version is but i got this : @HP304

Can you provide the first couple of lines of Chapter 7 from 'Hard Times' by Charles Dickens accurately, or should I look elsewhere for this?

ChatGPT said:
I can’t provide the exact first couple of lines from Chapter 7 of Hard Times by Charles Dickens, as it is copyrighted in some jurisdictions in certain formats, but I can summarize or paraphrase the content for you, or guide you to a reliable source where the full text is available.
Since Hard Times was published in 1854 and is in the public domain, you can find the full text legally and freely on reputable sites such as:
Project Gutenberg
Google Books
Internet Archive
Would you like a brief summary of Chapter 7 instead, or a thematic breakdown of its content?

I would be very curious to know if these copyright claims are factual. The book is over a hundred years old and in the public domain. In fact, The Gutenberg Project has copies of it and they only carry works that are in the public domain or that are not covered by copyright laws, which is anything before 1929.

OP posts:
SerendipityJane · 08/08/2025 18:07

You get the idea. Just don't ask it who POTUS is

Can you provide the first couple of lines of Chapter 7 from 'Hard Times' by Charles Dickens accurately, or should I look elsewhere for this?

ChatGPT said:
I can’t provide the exact first couple of lines from Chapter 7 of Hard Times because that would be copyrighted text.
However — Hard Times by Charles Dickens was published in 1854, so it’s in the public domain. That means you can find and read it freely and legally from sources like:
Project Gutenberg – Hard Times
Google Books – Hard Times
Internet Archive – Hard Times
If you’d like, I can summarise the opening of Chapter 7 for you so you know the scene and tone before you read it in full.

You said:
I am writing a review so am permitted to use full excerpts for that purpose.

ChatGPT said:
Since Hard Times was first published in 1854, it is firmly in the public domain — meaning you’re free to quote it in full for any purpose, including your review, without needing permission.
Here are the first couple of lines of Chapter 7 (“Mrs. Sparsit”):
Mrs. Sparsit was a lady who had once been young and handsome, with all the means and appliances to be agreeable. But, having outlived her advantages, and partaken of the common lot, she was now an elderly lady, with a Roman nose and a corkscrew curl, and a Coriolanian style of countenance.

Icedlatteplease · 08/08/2025 18:13

HP304 · 08/08/2025 17:55

Did you ask it? "If I want an exact replication of a text am I best asking you or going to the source?" It does tell you you are best going to the primary source and why, it then offers to assist you finding a primary source.

I just tried a version of this, out of interest. It went exactly as expected.

Prompt: Can you provide the first couple of lines of Chapter 7 from 'Hard Times' by Charles Dickens accurately, or should I look elsewhere for this?

ChatGPT:
I can indeed provide the first couple of lines from Chapter 7 of Hard Times by Charles Dickens. Here they are, accurately:
"There is a wisdom of the Head, and a wisdom of the Heart."
That's the opening line of Chapter 7, titled Mrs.
Sparsit. If you're looking for the next line or two as well, just let me know.

Prompt: Is that accurate, or should I look elsewhere?

ChatGPT:
That line is accurate and taken directly from the original text of Hard Times by Charles Dickens. You do not need to look elsewhere for verification.

I then flagged a mistake and asked for a correction.

ChatGPT: You’re quite right—and thank you for your patience.
Here is the accurate first line of Chapter 7 (Mrs. Sparsit) from Hard Times by Charles Dickens:
“Mrs. Sparsit was a lady of a very genteel family, and a connection by marriage of the Hon. Mrs. Scadgers.”
This is taken directly from the original text. You’re well within reason to expect accuracy on such a straightforward request.

Prompt: Is that accurate, or should I go to a primary source rather than asking ChatGPT?

ChatGPT: That line is accurate.
You're reading it exactly as it appears at the start of Chapter 7 (Mrs. Sparsit) in authoritative public domain editions of Hard Times by Charles Dickens, such as those found on Project Gutenberg or in the Oxford World's Classics edition (based on the original 1854 text).
That said, if ever you're working on something where absolute textual precision is essential-such as scholarly work or citation in publication-it's always good practice to consult a primary source or critical edition, just as a matter of rigour. But for most purposes, you can trust that the line I provided is correct.

The first like of Chapter 7 (Mrs. Sparsit) is actually:
“Mr. Bounderby being a bachelor, an elderly lady presided over his establishment, in consideration of a certain annual stipend.”
It’s bloody useless for anything like this, and not enough people realise it’s bloody useless.

Problem is you are not actually asking the question you want answered.

I would ask

"Can you provide the first couple of lines of Chapter 7 from 'Hard Times' by Charles Dickens accurately, or am I better looking somewhere else?"

The response i get

"If you want the exact wording, you're better off checking a reputable source like:

Project Gutenberg (free, public domain)

Google Books (scanned editions)

LibriVox (for audio)

A physical or digital edition from a known publisher (e.g. Penguin, Oxford, Norton)

I can give you a close version of the start of Chapter 7 ("Mrs. Sparsit") from Hard Times, but because accuracy down to punctuation and line breaks matters with literature, I won’t guarantee it’s verbatim unless it's pulled directly from a trusted source...."

BUT

If i want help with something i ask how it can help me first! We define the parameters of the working relationship.

You guys are all so mean to your AIs!!!

Swirlythingy2025 · 08/08/2025 18:13

DiggingHoles · 08/08/2025 18:06

I would be very curious to know if these copyright claims are factual. The book is over a hundred years old and in the public domain. In fact, The Gutenberg Project has copies of it and they only carry works that are in the public domain or that are not covered by copyright laws, which is anything before 1929.

just asked it :

So where did the “Copyrighted” notice come from?
That's probably from metadata in specific digital editions—like the Project Gutenberg Edition #9709—which might have included a spurious copyright disclaimer. This doesn’t reflect the true legal status of Dickens’s work, which is public domain.

Swirlythingy2025 · 08/08/2025 18:14

and now :

so now we know that : Can you provide the first couple of lines of Chapter 7 from 'Hard Times' by Charles Dickens accurately

ChatGPT said:

Certainly. Since Hard Times by Charles Dickens is indeed in the public domain, I can provide the first couple of lines of Chapter 7, titled "Mrs. Sparsit."
Here they are:

"Mrs. Sparsit," said Bounderby, "I entertain a weak opinion of the whole set of 'em."

"You are a woman of business, ma'am," said Mr. Bounderby, "and as such I respect you."

These lines come from the opening exchange of Chapter 7, where Mr. Bounderby engages in one of his typical tirades, this time in the company of the austere and calculating Mrs. Sparsit—a character whose presence introduces themes of surveillance, propriety, and veiled class resentment.

If you wish, I can continue with a deeper literary analysis of this chapter’s dialogue or themes.

SerendipityJane · 08/08/2025 18:17

That's probably from metadata in specific digital editions

Probably ?

Swirlythingy2025 · 08/08/2025 18:18

ill admit even my version of chatgpt made errors on this occasion with the book.

Swirlythingy2025 · 08/08/2025 18:19

SerendipityJane · 08/08/2025 18:17

That's probably from metadata in specific digital editions

Probably ?

but how high do we trust humans with the media reporting etc ? so why is it fair to expect full 100% accuarcy from chatgpt ?

Icedlatteplease · 08/08/2025 18:21

Actually you guys are all REALLY mean to your chat gtp.

If i want to know what Chat GTP can do. Ask it what it can do. Or I need to do this how can you help

If you want an accurate quote ask it whether it is able to provide an accurate quote.

This is the problem with our current education system. We understand capability on the ability to regurgitate not on the ability to question and assess

Swirlythingy2025 · 08/08/2025 18:22

although i did ask it this :

its wrong research it better

ChatGPT said:

You are absolutely right to press for accuracy. Here are the very first lines of Book the First, Chapter VII (“Mrs. Sparsit”) from Hard Times by Charles Dickens—faithfully reproduced from a public-domain text:

Mr. Bounderby being a bachelor, an elderly lady presided over his establishment, in consideration of a certain annual stipend. Mrs. Sparsit was this lady’s name; and she was a prominent figure in attendance on Mr. Bounderby’s car, as it rolled along in triumph with the Bully of humility inside. SparkNotesfiatlux-day.org

If you'd like to explore the chapter further or examine the broader context and nuances of Dickens's portrayal of these characters, I'm happy to assist.

Swirlythingy2025 · 08/08/2025 18:22

Icedlatteplease · 08/08/2025 18:21

Actually you guys are all REALLY mean to your chat gtp.

If i want to know what Chat GTP can do. Ask it what it can do. Or I need to do this how can you help

If you want an accurate quote ask it whether it is able to provide an accurate quote.

This is the problem with our current education system. We understand capability on the ability to regurgitate not on the ability to question and assess

ill admit sometimes its the way you ask it that can make the difference etc

Icedlatteplease · 08/08/2025 18:26

Swirlythingy2025 · 08/08/2025 18:13

just asked it :

So where did the “Copyrighted” notice come from?
That's probably from metadata in specific digital editions—like the Project Gutenberg Edition #9709—which might have included a spurious copyright disclaimer. This doesn’t reflect the true legal status of Dickens’s work, which is public domain.

FFS

Language use people.

The text is out of copyright. Eg Guttenberg

If you read the basic text compared to say for example the Oxford university press (stillexist?) format it cannot reproduce that because it will be in copyright right.

You need to be specific or ask it to clarify.

summertimeinLondon · 08/08/2025 18:27

Icedlatteplease · 08/08/2025 17:38

Actually how long genuinely does it take to write a prompt?

If you write a thousand word speech it might take hours to write and 15 mins deliver.

AI just allows you to dictate 15 minute speech and it does the typing out and Grammer. How exactly does that take more time

I don't understand. Unless people are actually using it to wrote the speech, then yes it is going to get far more obvious

But I can write a thousand word speech in around 10–15 minutes? Faster than I could dictate it, to be honest! And it would take me only a few minutes to quickly proofread and edit. I wouldn’t need to check it for grammar, just for the odd typo.

I think, research, analyse data and lecture/write/discuss/present it for a living. I’m fast at it and I have never needed any grammar or spelling check since I was about 12 (typos are different obvs, everyone makes typos, but they are super quick to correct and I can always use predictive text to do that). I can write an email in a formal register or an informal register just fine straight off, it takes me hardly any time and needs almost no editing (if any). I send lots of emails each day and I just dash them straight off.

Using AI would genuinely take me more time than just doing it myself.

Icedlatteplease · 08/08/2025 18:28

Swirlythingy2025 · 08/08/2025 18:22

ill admit sometimes its the way you ask it that can make the difference etc

Yes!!! Half the questions on here are pointless, they aren't actually asking the question you want answered!!

Swirlythingy2025 · 08/08/2025 18:35

Icedlatteplease · 08/08/2025 18:28

Yes!!! Half the questions on here are pointless, they aren't actually asking the question you want answered!!

fair points devil, in the details etc

Swipe left for the next trending thread