I asked Claude for information about a medical assessment and it told me that many people share my particular difficulties with diagnostic criteria and it told me that this was a frequently felt frustration. I asked for details and references so that I could read about this frustration, whereupon it said that it had only included that comment as a way to support me and it admitted that this was completely without any factual basis.
On the other hand, I have found that it is excellent at assessing test results and highlighting trends and anomalies. It also suggested tests that I should ask my GP for, the results of which have been transformative and I get slightly scared when I think how vulnerable I would have been had I not asked for the analysis and requested the tests Claude suggested. Whilst it’s true that the NHS test results show if a result is high, low or abnormal, I found that medical staff underplay some test results because I’m often on the low side of scores and they didn’t pull different trends together.
A couple of times I have pushed back on information from Claude and I found that it was giving me information that was misaligned with my query. Eventually, I got the information I wanted, which Google hadn’t been able to churn up. So you still have to think.
You have to treat it exactly like a Google search: blunt and factual. In connection with that, I think it is important to highlight that lexical fillers, such as please, thank you. could you and, in fact, any wording that is not directly to the point, in fact costs millions of dollars and hundreds of gallons of water because the LLM has to filter out what the question is and the issues are, from the verbiage that surrounds it.
Despite the environmental cost, I will continue to use it because it is a much better search engine than Google and presents the information in an easy to read form. I value its ability to look back over information that I have provided over a period of time and to pull it all together, whereas I know from experience that that humans overlook stuff, forget stuff and don’t have the time or inclination.