A simple principle that explains everything from the perceived success of speed cameras and alternative medicine to the Sports Illustrated jinx

According to urban legend, sports stars who appear on the cover of Sports Illustrated will subsequently experience bad luck. This seems counterintuitive but time and time again the Sports Illustrated jinx repeats itself. Take another example that at first might seem unrelated: Flight cadets have been noted to improve in performance immediately following punishment and show poorer performance immediately following rewards - a finding that seemingly flies in the face of much of what we know about behavioural psychology. Think about your own life for a moment, have you ever noticed this effect? Why might this be the case?


In both cases, as Nobel prize winning economist Daniel Kahneman explains in Thinking Fast and Slow, the answer is nothing to do with what we might expect - the fact that the sportsmen and women appeared on Sports Illustrated or the way the flight cadets were rewarded or punished. The real explanation is all down to probability - a principle known as regression to the mean. Wherever we can expect random fluctuations, if we take an extreme example such as a sportsmen who is on a winning streak or a flight cadet performing particularly well or badly, we can expect that in the immediate future their performance will return closer to the mean due to chance alone. A classic example of this is in how we interpret the effect of speed cameras which are typically installed following a streak of accidents. Following a streak of accidents we can expect that due to random chance there will be a period of time where no accidents take place, regardless of whether or not a speed camera is installed - but when a speed camera is installed we attribute the subsequent immediate drop in accidents as a result of the speed camera.

Regression to the mean can be used to explain the success of alternative medicine (i.e. any intervention that has not passed the test of randomised controlled trials). This is due to the fact that people often tend to get better by themselves given time - they regress to the mean. Statistically, having a headache for example, is an extreme situation. You're most likely to seek help for symptoms when the pain is at its most severe. If you have a headache and take a homeopathic pill you might feel better because of the placebo effect - but you might just feel better because your headache passed all by itself - regression to the mean. This can be a problem for all kinds of research if an experiment is not carefully controlled. If a patient group is selected for their extreme symptoms we can expect that as a group their condition will generally improve over time regardless of any intervention.

A thought experiment presented by Daniel Kahneman is to consider the case that "highly intelligent women tend to marry men that are less intelligent than they are". Take a moment to think about that. As humans, we naturally tend to spot patterns such as this and come up with our own causal explanations. The solution proposed by Kahneman is somewhat more straightforward: "If the correlation between the intelligence of spouses is less than perfect and if men and women on average do not differ in intelligence then it is a mathematical inevitability that highly intelligent women will be married to husbands who are on average less intelligent than they are - and vice versa of course". Whether we like it or not we are programmed to seek causal explanations even when they do not exist and that is something we need to actively remember if we don't want to be misled - or mislead ourselves.

It's staggering how few adults understand the concept of regression to the mean, but it really is a concept worth getting to grips with. This video introduces the concept beautifully:

Related post: How being called smart can actually make you stupid.

To keep up to date with this blog you can follow Neurobonkers on TwitterFacebookRSS or join the mailing list.

Image Credit: Shutterstock/soliman design 

​There are two kinds of failure – but only one is honorable

Malcolm Gladwell teaches "Get over yourself and get to work" for Big Think Edge.

Big Think Edge
  • Learn to recognize failure and know the big difference between panicking and choking.
  • At Big Think Edge, Malcolm Gladwell teaches how to check your inner critic and get clear on what failure is.
  • Subscribe to Big Think Edge before we launch on March 30 to get 20% off monthly and annual memberships.
Keep reading Show less

Why the ocean you know and love won’t exist in 50 years

Can sensitive coral reefs survive another human generation?

Videos
  • Coral reefs may not be able to survive another human decade because of the environmental stress we have placed on them, says author David Wallace-Wells. He posits that without meaningful changes to policies, the trend of them dying out, even in light of recent advances, will continue.
  • The World Wildlife Fund says that 60 percent of all vertebrate mammals have died since just 1970. On top of this, recent studies suggest that insect populations may have fallen by as much as 75 percent over the last few decades.
  • If it were not for our oceans, the planet would probably be already several degrees warmer than it is today due to the emissions we've expelled into the atmosphere.
Keep reading Show less

Why modern men are losing their testosterone

Research has shown that men today have less testosterone than they used to. What's happening?

Flickr user Tom Simpson
Sex & Relationships
  • Several studies have confirmed that testosterone counts in men are lower than what they used to be just a few decades ago.
  • While most men still have perfectly healthy testosterone levels, its reduction puts men at risk for many negative health outcomes.
  • The cause of this drop in testosterone isn't entirely clear, but evidence suggests that it is a multifaceted result of modern, industrialized life.
Keep reading Show less

Health care: Information tech must catch up to medical marvels

Michael Dowling, Northwell Health's CEO, believes we're entering the age of smart medicine.

Photo: Tom Werner / Getty Images
Sponsored by Northwell Health
  • The United States health care system has much room for improvement, and big tech may be laying the foundation for those improvements.
  • Technological progress in medicine is coming from two fronts: medical technology and information technology.
  • As information technology develops, patients will become active participants in their health care, and value-based care may become a reality.
Keep reading Show less