10 Scientific "Breakthroughs" That Don't Stand Up to Scientific Scrutiny

Does smiling make you happier? These and many other popular claims in psychology are not standing up to scrutiny. Here's what that means for science.

A crucial element of scientific progress is the reproducibility of experiments and their results. A problem in contemporary academic institutions has been the discouragement of repeating experiments. The Economist reported in 2013 that in the midst of this deep lack of support for reproducing published studies, some people have been pushing back – most notably in the field of psychology.


A recent article by Christian Jarrett in The British Psychological Society’s Research Digest reveals both how active some researchers have been in scrutinizing influential findings through replicated trials from and how deep the stakes are for encouraging such efforts. He sheds light on ten common claims in psychology that are often cited and invoked as true but have not held up to re-testing:

1. Confident body language makes people feel more confident. 

2. Smiling makes people feel happier.

3. Individuals have a finite amount of self-control, where “the more of it you use in one situation, the less you have left over to deal with other demands.”

4. Making revisions after taking an exam can retroactively help to improve scores. [This seemingly unlikely yet influential finding now, like the others on this list, seems unlikely to be true.]

5. Behavior can be influenced by exposure to certain kinds of words. More specifically, “Exposure to words pertaining to aging will make you walk more slowly.”

6. Hygienic cleaning helps to ameliorate moral guilt (aka the “Macbeth Effect”).

7. Babies imitate others’ behaviors.

8. Images and feelings of being watched compel people to act more honestly.

9. Smelling oxytocin, the neurochemical released during cuddling and sex, makes people more trusting of others.

10. Mentioning money makes people act more selfishly.

Image: nature.com

Jarrett locates the experimental origins of all of these influential, frequently cited claims. Then, with each one, he reveals a battery of recent tests that have been done aiming to replicate the findings. In every case, the attempts have been unsuccessful, usually indicating no relationship between the relevant variables (e.g., between smiling and feelings of happiness).

Yet the paper arguing that smiling makes the smiler feel more pleasant has been cited more than 1,500 times. Meanwhile, its conclusions continue to elude researchers trying to reproduce the experimental results or scrutinize the original data. Jarrett points to a recent study in Psychological Science critiques the original paper about bold body language as well as a follow-up that was published and finds that the experimental data that was used does not reflect statistically significant data. Professors Joseph P. Simmons and Uri Simonsohn, the authors of the recent critiques, sum their findings succinctly by asking: “Does the literature reviewed by Carney et al. (2015) [the researchers behind the original paper] suggest the existence of an effect once we account for selective reporting? We conclude not.” They arrive at their conclusion through statistical analysis of the original data.

The purported happiness-inducing effects of smiling have similarly not been standing up to scrutiny. As Jarrett demonstrates in another article in Research Digest, 17 different labs tried independently to regenerate this well-known finding. And they failed. The researchers claimed, “Overall, the results were inconsistent with the original result.” Not only do these findings suggest that the original finding is difficult to generate but also that, given how many studies have now been done, that the original conclusions may most likely be deeply wrong.

The failure of so many findings in academic and popular psychology to persist through repeated trials has direct implications for how we ought to apply the findings to our lives. For example, if confident body language does not evoke feelings of confidence, then gesturing boldly when feeling insecure may be effective only in appearing more awkward.

More broadly, these studies demonstrate the importance of actively encouraging researchers to perform and publish on repeat-trials. This, as Jarrett demonstrates, is crucial to interrogating consequential conclusions of experimental researchers. The stakes are high. If the causal link between smiling and a spike is happiness is blurrier than we once thought, what other claims are taken for granted in psychology? In physics? In medicine?


Compelling speakers do these 4 things every single time

The ability to speak clearly, succinctly, and powerfully is easier than you think

Former U.S. President Barack Obama speaks during a Democratic Congressional Campaign Committee rally at the Anaheim Convention Center on September 8, 2018 in Anaheim, California. (Photo by Barbara Davidson/Getty Images)
Personal Growth

The ability to communicate effectively can make or break a person's assessment of your intelligence, competence, and authenticity.

Keep reading Show less

This 5-minute neck scan can spot dementia 10 years before it emerges

The results come from a 15-year study that used ultrasound scans to track blood vessels in middle-aged adults starting in 2002.

Mikhail Kalinin via Wikipedia
Mind & Brain
  • The study measured the stiffness of blood vessels in middle-aged patients over time.
  • Stiff blood vessels can lead to the destruction of delicate blood vessels in the brain, which can contribute to cognitive decline.
  • The scans could someday become a widely used tool to identify people at high risk of developing dementia and Alzheimer's.
Keep reading Show less

Preserving truth: How to confront and correct fake news

Journalism got a big wake up call in 2016. Can we be optimistic about the future of media?

Videos
  • "[T]o have a democracy that thrives and actually that manages to stay alive at all, you need regular citizens being able to get good, solid information," says Craig Newmark.
  • The only constructive way to deal with fake news? Support trustworthy media. In 2018, Newmark was announced as a major donor of two new media organizations, The City, which will report on New York City-area stories which may have otherwise gone unreported, and The Markup, which will report on technology.
  • Greater transparency of fact-checking within media organizations could help confront and correct fake news. Organizations already exist to make media more trustworthy — are we using them? There's The Trust Project, International Fact-Checkers Network, and Tech & Check.
Keep reading Show less