Meet the Other Phone. Only the apps you allow.

Meet the Other Phone.
Only the apps you allow.

Buy now

Please or to access all these features

Chat

Join the discussion and chat with other Mumsnetters about everyday life, relationships and parenting.

How to know ChatGPT is full of shit.

246 replies

DiggingHoles · 06/08/2025 17:50

Take a book of a shelf. A classic is best. Open up to the first page of a random chapter. Now ask ChatGPT to quote the first paragraph of that chapter.

Tip: Have some popcorn ready while you rephrase your request multiple times.

OP posts:
Thread gallery
8
TheCurious0range · 08/08/2025 09:28

Icedlatteplease · 08/08/2025 09:26

Do you not have your own system ai s though? AI is not just chat gtp.

There's also a difference between write a report. And I need to include this information (professional judgements) turn it into the specified format. If your trained people can do more work because ai is doing the legwork.....

Instead golf looking for people who can write reports, your looking for the best ones with professionals judgements

We have encrypted co-pilot which is permitted for things like minuting strategic/team type meetings , but not legal reports or the bulk of the operational work

Icedlatteplease · 08/08/2025 09:48

TheCurious0range · 08/08/2025 09:28

We have encrypted co-pilot which is permitted for things like minuting strategic/team type meetings , but not legal reports or the bulk of the operational work

Why?

Report writing is so easy for AI. Professional opinion far harder. But they are very different skills?

TheCurious0range · 08/08/2025 10:14

Icedlatteplease · 08/08/2025 09:48

Why?

Report writing is so easy for AI. Professional opinion far harder. But they are very different skills?

It's not my rule it's the government's! We do deal with very very sensitive information

Icedlatteplease · 08/08/2025 10:47

I suppose that's what bugs me.

You guys are the type of people where AI, (do correct me) SHOULD make a massive difference. I would guess you need professional judgements way more than report writers. Report writing is usually formulaic.

Government should be the people that have this technology (in a safe secure environment). We've left development to big businesses.

Government sets the rules. But they seem so far behind the technology

whitewineandsun · 08/08/2025 10:50

Ponderingwindow · 06/08/2025 17:57

Ask it to write a short news bio about yourself.

For me it assigns the wrong area of expertise and creates papers I have not written out of thin air.

I find this really sinister tbh.

DiggingHoles · 08/08/2025 10:52

summertimeinLondon · 08/08/2025 09:06

But the reason we teach times tables is that they underpin the understanding of higher level maths.

Just to outsource all those basic tasks to AI will end up with an incredibly deskilled population — just when it’s the higher level knowledge skills that are actually needed to use and compete with AI.

How to use Exel can be learned in an afternoon; but basic maths is invaluable for building skills and knowledge across nearly all disciplines.

Do we really want a huge amount of the population to be deskilled and useless because it’s easier to use AI? How will they understand what to fact check and how information works, in that case?

This is already happening. There are a lot of students leaving primary school or even high school without being able to read. They use text-to-speech software to understand printed text, because they do not have the ability to actually read it themselves. This is such a basic skill. But these kind of tools are creating entire generations of illiterates.

Getting the correct answers should be the result of a student's knowledge and capabilities. Otherwise, what is the point of testing them? If they use a Generative AI, you are not testing them, you are testing the AI. In such a case the students merely become AI-conduit-tools for the teacher. Surely, parents would not want that?

OP posts:
SerendipityJane · 08/08/2025 11:04

TheCurious0range · 08/08/2025 09:06

Because it's not permitted in parts of our industry (criminal justice) , it's a sackable offence to use it for particular legal reports, so if I direct staff not to use it they must follow that instruction. If they can't do that, I don't want to employ them

Is the the same criminal justice system that has just admitted fucking cases up for years ?

I'm sorry to say I have zero interest in what they have to say about IT.

https://www.bbc.co.uk/news/articles/cwye2q00k51o

A digitally altered image of the Statue of Justice holding a balance scale. The statue is overlaid with binary code (1s and 0s) in blue, giving it a futuristic and technological appearance. The background features abstract patterns in green, yellow, an...

Courts service accused of covering up IT bug that caused evidence to go missing

Sources say judges in courts and tribunals will have made rulings when evidence was incomplete.

https://www.bbc.co.uk/news/articles/cwye2q00k51o

Icedlatteplease · 08/08/2025 11:17

DiggingHoles · 08/08/2025 10:52

This is already happening. There are a lot of students leaving primary school or even high school without being able to read. They use text-to-speech software to understand printed text, because they do not have the ability to actually read it themselves. This is such a basic skill. But these kind of tools are creating entire generations of illiterates.

Getting the correct answers should be the result of a student's knowledge and capabilities. Otherwise, what is the point of testing them? If they use a Generative AI, you are not testing them, you are testing the AI. In such a case the students merely become AI-conduit-tools for the teacher. Surely, parents would not want that?

Does it really show illiteracy to access the information via your ears not your eyes? The information still goes to your brain in both cases.

Is it blind man illiterate because he can't read?

I know and can teach concept understanding on multiplication no worries, in various different formats with different visual stimulus. I can use multiplication with higher maths level concepts no problem. Put me on the spot 6×7. Nope.

Literacy is not the same as assisted input

Icedlatteplease · 08/08/2025 11:20

whitewineandsun · 08/08/2025 10:50

I find this really sinister tbh.

Garbage in garbage out.

Did you ask it to create a bio or use specific information to create a bio?

Linguistically you havent actually specified whether it was aloud to make stuff up or not

SerendipityJane · 08/08/2025 11:33

Icedlatteplease · 08/08/2025 11:20

Garbage in garbage out.

Did you ask it to create a bio or use specific information to create a bio?

Linguistically you havent actually specified whether it was aloud to make stuff up or not

Feed it back into another "AI" bot and see what it says.

TheCurious0range · 08/08/2025 11:39

SerendipityJane · 08/08/2025 11:04

Is the the same criminal justice system that has just admitted fucking cases up for years ?

I'm sorry to say I have zero interest in what they have to say about IT.

https://www.bbc.co.uk/news/articles/cwye2q00k51o

I don't work for HMCTS , also not a fan!

SerendipityJane · 08/08/2025 11:46

TheCurious0range · 08/08/2025 11:39

I don't work for HMCTS , also not a fan!

Well reading that story, neither does anyone else.

I wonder how many people will have their convictions overturned ? Thank goodness we abolished compensation for miscarriages of justice.

DiggingHoles · 08/08/2025 11:47

Icedlatteplease · 08/08/2025 11:17

Does it really show illiteracy to access the information via your ears not your eyes? The information still goes to your brain in both cases.

Is it blind man illiterate because he can't read?

I know and can teach concept understanding on multiplication no worries, in various different formats with different visual stimulus. I can use multiplication with higher maths level concepts no problem. Put me on the spot 6×7. Nope.

Literacy is not the same as assisted input

Here is the definition of "illiteracy", just so we don't needlessly argue about it:
https://dictionary.cambridge.org/dictionary/english/illiteracy

People who are blind can learn to read and write. There is Braille for reading and typing can be done blindly, that's why most keyboard come with small ridges on the "j" and "f" (and "5" on the numpad) keys. This allows people to use keyboards without looking.

But no, it does not cover text-to-speech. That is not reading. I may say that I am "reading" an audio book, but it's a figure of speech, because it does not use the same cognitive process as reading text does.

illiteracy

1. a lack of the ability to read and write: 2. a lack of knowledge about a…

https://dictionary.cambridge.org/dictionary/english/illiteracy

OP posts:
TheCurious0range · 08/08/2025 11:53

SerendipityJane · 08/08/2025 11:46

Well reading that story, neither does anyone else.

I wonder how many people will have their convictions overturned ? Thank goodness we abolished compensation for miscarriages of justice.

Maybe we shouldn't have, sometimes financial penalties focus the mind! Like last year when Serco took over the EMS contract, didn't have enough staff or tags so people were being released untagged for months, government invoked a million pound a month fine for breach of contract and within 2 months they were fully caught up....

SerendipityJane · 08/08/2025 11:54

DiggingHoles · 08/08/2025 11:47

Here is the definition of "illiteracy", just so we don't needlessly argue about it:
https://dictionary.cambridge.org/dictionary/english/illiteracy

People who are blind can learn to read and write. There is Braille for reading and typing can be done blindly, that's why most keyboard come with small ridges on the "j" and "f" (and "5" on the numpad) keys. This allows people to use keyboards without looking.

But no, it does not cover text-to-speech. That is not reading. I may say that I am "reading" an audio book, but it's a figure of speech, because it does not use the same cognitive process as reading text does.

Did you read the thread where a number of posters declared that the dictionary was wrong, and they were right ?

With more irony than that is universe, the argument was over the meaning of "plonker".

So we have already raised a cohort of people for whom reality is "what I think".

Enjoy the rest of your life ! I think hell is having to live through the next few years 😀

Nchangeo · 08/08/2025 11:57

To be fair I asked it to review our business. Write the USPs and what separated us from others.

It got it spot on.

So it’s come on a long way since I asked it to do something a year ago.

Icedlatteplease · 08/08/2025 12:01

DiggingHoles · 08/08/2025 11:47

Here is the definition of "illiteracy", just so we don't needlessly argue about it:
https://dictionary.cambridge.org/dictionary/english/illiteracy

People who are blind can learn to read and write. There is Braille for reading and typing can be done blindly, that's why most keyboard come with small ridges on the "j" and "f" (and "5" on the numpad) keys. This allows people to use keyboards without looking.

But no, it does not cover text-to-speech. That is not reading. I may say that I am "reading" an audio book, but it's a figure of speech, because it does not use the same cognitive process as reading text does.

Classic.

Youre dictionary definition has two definitions. I was using literacy in the sense of the second.

So you don't need to have literacy to be literate.

Or you don't have to be able to read if you can understand through hearing the text.

Or to use your specific example You may need to read to read the definitions, but understanding is knowing which of the two to apply.

DiggingHoles · 08/08/2025 12:02

SerendipityJane · 08/08/2025 11:54

Did you read the thread where a number of posters declared that the dictionary was wrong, and they were right ?

With more irony than that is universe, the argument was over the meaning of "plonker".

So we have already raised a cohort of people for whom reality is "what I think".

Enjoy the rest of your life ! I think hell is having to live through the next few years 😀

You mean the Cambridge dictionary or any dictionary? I used dictionaries so often as a child. That and encyclopedias. We didn't get internet till I was in my teens. I am very glad to have all the skills we needed to develop from before, although my math skills have faded a bit since college.

I have find the secret to "enjoying" life (so to speak) is to live on the sides of it. Ignore a whole bunch and just do what actually interests me. But I also keep an eye on what is going on with the world.

But this is a much more serious answer than you were asking for, I think 😅

OP posts:
Nchangeo · 08/08/2025 12:02

DiggingHoles · 08/08/2025 10:52

This is already happening. There are a lot of students leaving primary school or even high school without being able to read. They use text-to-speech software to understand printed text, because they do not have the ability to actually read it themselves. This is such a basic skill. But these kind of tools are creating entire generations of illiterates.

Getting the correct answers should be the result of a student's knowledge and capabilities. Otherwise, what is the point of testing them? If they use a Generative AI, you are not testing them, you are testing the AI. In such a case the students merely become AI-conduit-tools for the teacher. Surely, parents would not want that?

They are going to have to do some kind of closed benchmarking essay in exam conditions no computer. Provide all the papers/ texts required. And have students come back for a couple of days to complete.

Not all assignments; as that’s not facilitating independent research which is half the game. But just a once a year closed exam to gauge comprehension, essay skills, writing etc.

BubblyBath178 · 08/08/2025 12:05

It’s not perfect but I love using it for building holiday itineraries. You’ve got to be fairly specific about the kind of things you want to do but from there it can find more great things. I’ve now got my potential itinerary for a trip to Salem, New Orleans and Philadelphia.

Icedlatteplease · 08/08/2025 12:06

Nchangeo · 08/08/2025 12:02

They are going to have to do some kind of closed benchmarking essay in exam conditions no computer. Provide all the papers/ texts required. And have students come back for a couple of days to complete.

Not all assignments; as that’s not facilitating independent research which is half the game. But just a once a year closed exam to gauge comprehension, essay skills, writing etc.

Personally I think it would make more sense to go the other way.

Do you want someone who can remember a definition. Or someone who may not be able to memorise a definition, but knows how to access the information and can decide how to apply it?

Icedlatteplease · 08/08/2025 12:07

BubblyBath178 · 08/08/2025 12:05

It’s not perfect but I love using it for building holiday itineraries. You’ve got to be fairly specific about the kind of things you want to do but from there it can find more great things. I’ve now got my potential itinerary for a trip to Salem, New Orleans and Philadelphia.

Please do independently check the opening hours etc if you are using chat gtp. It is not at all good at that.

Icedlatteplease · 08/08/2025 12:11

DiggingHoles · 08/08/2025 11:47

Here is the definition of "illiteracy", just so we don't needlessly argue about it:
https://dictionary.cambridge.org/dictionary/english/illiteracy

People who are blind can learn to read and write. There is Braille for reading and typing can be done blindly, that's why most keyboard come with small ridges on the "j" and "f" (and "5" on the numpad) keys. This allows people to use keyboards without looking.

But no, it does not cover text-to-speech. That is not reading. I may say that I am "reading" an audio book, but it's a figure of speech, because it does not use the same cognitive process as reading text does.

So are you really saying if you understand the text through your sense of touch it's reading, but through your sense of sound it isn't.
Does it matter if your literacy (second definition) is through touch, sight or sound?

DiggingHoles · 08/08/2025 12:14

Icedlatteplease · 08/08/2025 12:01

Classic.

Youre dictionary definition has two definitions. I was using literacy in the sense of the second.

So you don't need to have literacy to be literate.

Or you don't have to be able to read if you can understand through hearing the text.

Or to use your specific example You may need to read to read the definitions, but understanding is knowing which of the two to apply.

Youre dictionary definition has two definitions. I was using literacy in the sense of the second.

Here is the second definition:
"a lack of knowledge about a particular subject"

I would argue that both definitions apply here. Kids can't read and therefore also lack the knowledge of the subject of reading. When I learned to read I did not just have to read text. I had to analyze it. I had to be able to answer questions and provide quotes to the relevant sections that contained the answer to the questions. I also had to list the main subject of the text, as well as the other less important topics that were discussed. (English is not my first language, so the terms we used for reading comprehension are different from what you are probably used to, so my apologies if I use the incorrect ones in English.)

Since ChatGPT can't even quote a paragraph correctly, how are kids going to use it to answer these questions? Furthermore, how are kids going to develop understanding of a text if all they can do is listen to it? How will that improve their vocabulary? How will they learn to spell when faced with a situation where all they have is pen and paper? How do they search a text for specific keywords if they can't even spell these words? How do they learn to skim a text to find a paragraph that is relevant to the information they are looking for? How will they learn to use a familiar text as reference to quickly look up something they have read before, which is something I used to do all the time when studying.

OP posts:
Swirlythingy2025 · 08/08/2025 12:23

@DiggingHoles same as when i need to learn anything, i get a book on the basics of which ever the subject is and teach myself and then use chatgpt to advance it further. society existed long before formal education system, so yea, people may struggle. but they can lean via a combination.