I first noticed it in Ted Talk clips. You know the sort of thing. A nicely lit stage with a big logo. Someone way too well groomed and friendly to be a scientist or an academic is strutting around, headset microphone positioned neatly below dazzling and shapely teeth.
If theyâre really good â and some of them are â they might use a prop. A neuroscientist, or a pseudo-neuroscientist, may have a model of a brain. Theyâll occasionally hold it up, âalas, poor Yorickâ-style, and look at it in awe as they declaim words such as frontal lobes, neuroplasticity, emotional intelligence or dopamine.
And then it happens. Hard and fast and painful. Yes, itâs the Overblown Science Claim.
The Claim is always preceded by a phrase such as âwe know from science thatâ, âscience shows thatâ, âstudies find thatâ or âit turns out thatâ. And the Claim itself, in the case of our neuroscientist, will be something like: âChildren who are able to resist eating a marshmallow if promised two later will grow up to become 326 per cent happier, six times richer, much more attractive in every way and over 10,000 times more likely to do a Ted Talk.â
Âé¶č
Since it first hit me, I canât help but notice the Claim all over the place: in popular science books, podcasts, literature reviews, newspapers, broadcast news, tweets and LinkedIn posts. And it irritates the hell out of me.
Why? To put it simply, itâs exaggeration bordering on making stuff up â from people who really should and probably do know better.
Âé¶č
I think I understand the motivations. There are books to sell. Punters to please. Grants to get. Reputations to enhance. $45KÂ keynotes to deliver. Teeth to re-veneer. Thatâs Edutainment! So nuance and humility â which should be hallmarks of science â arenât going to cut it. Any disclaimer will make the declaimerâs field â and, by extension, themselves â seem weak and uncertain.
I also wonder sometimes if another reason for over-claiming is that it helps some scientists manage their own discomfort. Over the course of their careers they may realise, to their dismay, that : there are more questions than answers, and the more we discover, the less we know.
Whatâs so bad about making the Claim? For a start, we donât know anything from science because we canât. We have only very partial knowledge. All we really can say is that given our limited data and the constraints of the methodology, a particular finding is more or less likely. And we can sometimes have a reasonable estimate of probabilities and likelihoods.
What about the claim that studies show something? Sure, some studies show something. But other studies do not show the same thing. So, again, itâs about probabilities rather than studies showing something.
Âé¶č
On top of this, published studies tell only part of the story. In many fields, hypothesis-supporting positive results are much more likely than negative results to get published. So the claim that studies show refers only to the unrepresentative bunch with positive results that actually see the light of day. This publication bias represents another quite bizarre rejection of a scientific hallmark by its own practitioners: to publish all your results, not only those you like.
Also, the Claim fails to consider future research. Of course, we canât know what this will find, but we do know itâs quite possible that it will reveal apparently well-established findings to be quite untrustworthy. New teams of researchers may fail to replicate the Claim. New research may even reveal that the methodology behind it â and behind perhaps thousands of other studies, carried out over decades â is flawed.
Isnât it just wrong for scientists to behave in ways that violate the basic principles of science as a profession and endeavour? When pharmaceutical companies selectively publish only the positive results of drug trials, we are outraged. When car manufacturers find ways to distort the levels of emissions produced by their vehicles, we see it as corruption. Yet, somehow, when scientists do something similar by making overblown claims, we donât make similar judgements.
But others may. Making overblown claims undermines trust in science and scientists because such claims, however confidently asserted, are very fragile and can easily be challenged or refuted. A single contradictory finding or questioning voice can be enough to shatter confidence, making it easy to interpret the Claim as a lie, the person who made it as a liar and science in general as fake news.
Âé¶č
The possibly self-interested and certainly bland âmore research is neededâ conclusion of many scientific papers is quite wrong. We do not need more research. We need better research. This means improving our practices around conducting, publishing and communicating science.
But while scientistsâ incentives remain as they are, it is hard to imagine them seeing the fun in that.
Âé¶č
Rob Briner is professor of organisational psychology at Queen Mary University of London, a visiting professor at Oslo New University and associate director of research at the Corporate Research Forum.
POSTSCRIPT:
Print headline: When edutainers make overblown claims about the evidence, science loses
Register to continue
Why register?
- Registration is free and only takes a moment
- Once registered, you can read 3 articles a month
- Sign up for our newsletter
Subscribe
Or subscribe for unlimited access to:
- Unlimited access to news, views, insights & reviews
- Digital editions
- Digital access to °Ő±á·Ąâs university and college rankings analysis
Already registered or a current subscriber?








