Four Times When Journalists Read a Scientific Paper and Reported the Complete Opposite
We all make small mistakes, but sometimes journalists report the complete and utter opposite of what a study really found.
Journalists sometimes make little mistakes when covering matters of science, and that’s understandable. Clearing up those mistakes was one of the primary motivations for starting this blog. But sometimes the mistakes aren’t little; sometimes journalists will literally report the complete and utter opposite of what a study actually found, and it’s those huge blunders that we’ll look at today.
Earlier this month a study led to headlines around the world falsely claiming that a vegetarian diet is worse for the environment than eating meat. This is categorically incorrect in the extreme as a quick glance at the carbon footprint of various foods makes very clear:
The study in fact did not compare vegetarian diets to the diets of meat eaters; rather it looked at various different versions of omnivorous diets. The factoid that so many journalists were hooked by was the observation that calorie for calorie, lettuce can have a larger environmental impact than bacon. This is an absurdly misleading claim, firstly due to the obvious fact that people don’t eat lettuce for the calories, making calories a ridiculous measure to use to compare lettuce and bacon. You’d have to eat an entire wheelbarrow load of lettuce in order to gain the calories of a packet of bacon. You might as well publish a nutritional analysis comparing the health benefits of doughnuts and smarties.
Furthermore, the environmental consequences of transporting and storing lettuce are obviously going to differ enormously depending on where the lettuce is grown. A leaf of lettuce grown on the cabbage patch down the road where there isn't high demand for groundwater isn’t going to result in the same amount of environmental damage as lettuce that has been flown halfway around the world from a place where water may be at a premium. The same can’t be said for livestock that consume resources on an order of magnitude above those required to produce the bulk of a vegetarian diet, before it even leaves the farm gate.
This headline appeared around the world earlier this month, but this isn’t what the study found at all; indeed the real findings were far more interesting. In reality the study had nothing to do with Facebook; the study looked at how “profound,” people rated ostensibly mundane quotes that were constructed of randomly mixed scientific buzzwords. For example: “Hidden meaning transforms unparalleled abstract beauty.” On average, people reported these quotes somewhere between “somewhat profound” and “fairly profound.” Roughly 27 percent of the participants gave the statements an average score above fairly profound — i.e., they judged the statements either “definitely profound” or “very profound."
In a follow-up experiment the researchers did indeed look at genuine inspirational quotes, for example: “A river cuts through a rock, not because of its power but its persistence.” But crucially, the researchers were only looking at people’s responses to these to compare them to their responses to the pseudo-profound quotes. The researchers subtracted the "profundity ratings" from the pseudo-profound quotes from the ratings participants gave for the legitimate quotes, finding that those with a higher level of analytic abilities were more able to spot the difference — a fact that is hardly surprising, and not nearly as interesting as the finding that most people are willing to believe that meaningless bunches of big scientific-sounding words are about as profound as genuine inspirational quotes with clear, metaphorical meanings.
Except that’s not what the study found. The researchers in fact looked at how people were perceived by others if they ended their texts with a period, and found that people ending texts with a period were perceived to be less sincere, by other people. This is a very common mistake in psychology journalism, a good one to watch out for when a psychological study is being summarized!
4. “Passive smoking doesn’t cause cancer”
Reported the (now deleted) headline of the Sunday Telegraph, straight out of the PR machine of British American Tobacco. The Sunday Telegraph even went as far as writing that passive smoking “could even have a protective effect” after failing to understand the meaning of a confidence interval. In reality, the study found the complete opposite — a 16 to 17 percent increase in lung cancers due to passive smoking.
Swipe right to make the connections that could change your career.
Swipe right. Match. Meet over coffee or set up a call.
No, we aren't talking about Tinder. Introducing Shapr, a free app that helps people with synergistic professional goals and skill sets easily meet and collaborate.
Is it "perverseness," the "death drive," or something else?
Eight-dimensional octonions may hold the clues to solve fundamental mysteries.
- Physicists discover complex numbers called octonions that work in 8 dimensions.
- The numbers have been found linked to fundamental forces of reality.
- Understanding octonions can lead to a new model of physics.
It's up to us humans to re-humanize our world. An economy that prioritizes growth and profits over humanity has led to digital platforms that "strip the topsoil" of human behavior, whole industries, and the planet, giving less and less back. And only we can save us.
- It's an all-hands-on-deck moment in the arc of civilization.
- Everyone has a choice: Do you want to try to earn enough money to insulate yourself from the world you're creating— or do you want to make the world a place you don't have to insulate yourself from?
SMARTER FASTER trademarks owned by The Big Think, Inc. All rights reserved.