To think ancedotal evidence does count?

(47 Posts)
Angelfootprints Wed 20-Feb-13 17:49:23

I have seen an increasing tactic on threads to dismiss anecdotal evidence From the "opposition". Especially on topics that are subjective ( religion, feminism , classism etc)

I think anecdotal evidence does count. It forms our life experiences and not everything can be measured in a scientific way. Some studies could be outdated, have an agenda or misinterpreted findings.

Science and studies don't always have the answers.

For example have been having medical problems which recently might be caused by a certain medication. There is no scientific studies to confirm this, yet googling this medication I have seen lots of women report these problems. Should I ignore all the anecdotal evidence because science (and the doctors) say it can't be true?

I think experiences from living, breathing people can be just as valid.

I agree with a lot of what ellie is saying.

Something anecdotal evidence is useful for is disproving. If you have a single contradictory example, that stands. It may not matter very much, but it's useful for stuff like when people say 'oh, all Christians believe gay people shouldn't marry'. In that situation just one person saying 'nope, I'm Christian and pro gay marriage' is enough. Though, then, naturally everyone ends up arguing about precise definitions of 'Christianity' and moving to the more general position 'most Christians believe ...'.

Occasionally I think the reason anecdotal evidence gets slammed on MN is it can come across as a little bit as if the person thinks their tiny, tiny, tiny amount of experience in the world really should count for more, proportionally, than it does.

Dahlen Thu 21-Feb-13 10:24:22

Anecdotal evidence does count in the sense that it is often the basis on which more scientific stiudies are based - i.e. someone sees a pattern in their own experiences or from what other people have told them and sets out to see if this is repeated on a larger scale, while factoring in appropriate controls, etc.

However, while anecdotal evidence can be strong, it isn't necessary accurate. Living in a particular area or among a certain social group can predispose you to the idea that what happens there is what happens everywhere, when really that area/group may be quite unrepresentative.

Science doesn't claim to prove anything. All a study can do us show that a theory hasn't proven to be false, for instance, general relativity showed Newtonian mechanics to be false, and currently we hold on to general relativity as it shows consistent results where theory matches data.

Could be that there comes a time when that is shown to be false too though.

Trills Thu 21-Feb-13 09:49:10

Poor reporting of studies does not mean they are poor studies. Yes.

A single anecdote may be true, it may be interesting, but it is unlikely to be a good basis for making a decision.

"I just think people sometimes blindly take it as the holy grail without questioning it or considering it could be wrong."

Anyone doing this does not understand how science works. That's not a reason to dismiss the scientific method, it's a reminder that people misinterpret and state as "if X then Y" on issues that are about risks and averages, not absolutes.

DadOnIce Thu 21-Feb-13 09:41:58

Sales of wine are shown to go up by 15% one Saturday night. The ratings of "Strictly Come Dancing" also go up by 15%. You can show a correlation on a graph between the increase in consumption of wine and the increase in viewers of "Strictly Come Dancing". It would, however, be inaccurate to presume the two are connected just because they form the same shape on a graph. You need to take account of other factors influencing an increase in wine purchase (maybe Oddbins had a special offer on that week) and other factors influencing the ratings of "Strictly Come Dancing" (maybe it was the semi-final, there had been a lot of publicity that week, different time-slot, etc., etc.).

DadOnIce Thu 21-Feb-13 09:39:53

Dismissing someone as "too lazy to engage with the argument" usually shows that you haven't understood what the argument actually is about. HTH.

kim147 Thu 21-Feb-13 09:37:03

You can't prove anything with 1 study.
It may be a perfectly good study, well carried out, but you can't prove anything with a single study. It needs to be repeatable.

KobayashiMaru Thu 21-Feb-13 09:34:07

poor reporting of studies does not mean they are poor studies Tsk tsk, such fundamental misconceptions.

kim147 Thu 21-Feb-13 08:32:46

"Anecdote is not data because correlation is not causation."

YY to that. grin

And just because 1 study shows something does not mean anything has been proved to be an effective cure (Daily Express - I'm looking at you)

For anyone interested in the (mis)use of statistics in real life, I'd recommend More or Less on Radio 4.

www.bbc.co.uk/programmes/b006qshd

Kungfutea Thu 21-Feb-13 07:36:42

Do you have any understanding of statistics toad and why what you said about how studies are carried out is meaningless?

seeker Thu 21-Feb-13 06:32:43

Anecdote is not data because correlation is not causation.

DolomitesDonkey Thu 21-Feb-13 06:29:24

Yanbu - by the very virtue of its nature evidence is often self-selecting anecdotal - particularly in light of the fact we don't conduct long-term laboratory experiments on homo sapiens. Sadly there are many unable to differentiate fact and logic from screaming mantra.

Dismissing an argument as 'anecdotal' merely shows, more often that not, that the person making the comment is simply too lazy to engage with the argument.

What's more, citing some scientific study in response is frequently even worse because the studies, being of very limited application, normally don't prove the point that the person citing them intends to make.

If is, for example, perfectly possible to conduct a scientific study in which various people bang their elbows on the table, run three times round their houses widdershins, eat six apples, then pray to The Great Green Arkleseizure, then if you run out of their houses and see if you are hit by a car. You could then compare the results with a control group and remark that taking the above actions is associated with being more / less likely to be hit by cars. It wouldn't be a study much more worthless than many being churned out by universities worldwide, and doubtlessly would be circulated on the Internet as 'evidence' of how you can make yourself less likely to be hit by cars.

delusionsofadequacy Wed 20-Feb-13 23:28:14

Slightly off topic but if the example in your op of the potential side effect is the case for you then you can report it to the mhra via their yellow card reporting system and then your anecdote will add to their statistics and who knows maybe it will become a recognised side effect! http://yellowcard.mhra.gov.uk/the-yellow-card-scheme/

andubelievedthat Wed 20-Feb-13 21:21:07

Small point ? perhaps ? but> the Copenhagen interpretation only works on a sub atomic level,when one tries to scale it up to the scale you speak of , it no longer applies,,and, it is a thought experiment .

DadOnIce Wed 20-Feb-13 20:51:46

You could bang your elbow on the table, run three times round your house widdershins, eat six apples, then pray to The Great Green Arkleseizure. Then if you run out of your house and narrowly avoid being hit by a car, you could claim that this proves the Great Green Arkleseizure exists because he saved you from being hit by a car. What, so the banging of the elbow, the running widdershins and the apples had no effect, then?

i.e. Most "anecdotal" evidence is just confirmation bias in practice.

KobayashiMaru Wed 20-Feb-13 20:47:12

If I smoke 40 a day yet live to be a hundred with never an illness, can I then tell everyone that I know for a fact that smoking does not cause cancer?

Your example shows you have somewhat misunderstood the point anyway.

MrsDeVere Wed 20-Feb-13 20:32:37

Anecdotes add interest to research.
Statistics add meaning.

All the study I have undertaken has been in social care/history.

Anecdotal evidence is vital. Its about the human experience. Numbers alone are pretty meaningless.

But anecdotes do not provide an overall picture and they are of course highly subjective.

I am quite a fan of Mr Goldacre but he, along with fricken Freakanomics, is far to glibly and frequently used on MN to dismiss valid experiences.

kim147 Wed 20-Feb-13 18:58:50

I wish someone would tell Gove about evidence and statistics.
Evidence based research before jumping in with some new policy based on his experiences and a few anecdotes.

DadOnIce Wed 20-Feb-13 18:48:52

Yes, the key emotive word is "invalid". Statistically, a single person's anecdotal evidence is invalid - when it comes to actually being relevant for proving an argument wrong. That's not the same as saying it is invalid for them - it may have been valuable, meaningful, but it isn't relevant.

Often, it's simply confirmation bias in action. Anyone remember Derren Brown with the horse-racing? And the comparison with homeopathy?

Whyriskit Wed 20-Feb-13 18:47:43

As part of my degree I did some qualitative microanalysis of parent/child interactions. The professor supervising the project was world renowned in the field of child development but without stats it did all feel a bit woolly.

EllieArroway Wed 20-Feb-13 18:44:09

Yeah - but Dad - they couldn't find any men in their sample (apparently) who hadn't looked at porn so couldn't make a comparative study.

Mind you - some might have been saying they had when really they hadn't, so you might be right.

RichardSimmonsTankTop Wed 20-Feb-13 18:41:20

"A lot of posters will mock the poster- but really your on to a losing battle as you cannot prove your position. How could you?It doesn't mean its not the truth though and what the poster is saying is invalid."

If they're talking about their own experience of course it's not 'invalid', but if they're saying that their experience negates the science, yes, the conclusion that the person is drawing is incorrect.

EllieArroway Wed 20-Feb-13 18:40:55

As Kim said - most people using stats to try and prove something don't really understand stats.

And all that study about porn demonstrates is that it is "unlikely" that a man has never looked at porn - not that there's absolutely no men anywhere that don't.

DadOnIce Wed 20-Feb-13 18:40:52

Well, the porn thing is a classic example of the Heisenberg Uncertainty Principle in action - you affect the thing being studied by the act of studying it. The same is true of sex surveys in magazines - people won't be completely honest.

For things which you can't "prove" you can still collect evidence. Nobody can prove fairies don't exist, but given that every example of fairies so far found in the world is fictional or a hoax, one can comfortably draw the conclusion that they don't. Unless new evidence comes to light.

I suppose what I was saying above about anecdotes is that there will always be examples which appear to "contradict" or "disprove" a theory - until you look into them, weigh them against the other evidence, and realise they actually don't.

Join the discussion

Join the discussion

Registering is free, easy, and means you can join in the discussion, get discounts, win prizes and lots more.

Register now