A new study proves parachutes are useless

A new study flies in the face of anecdotal evidence and raises questions about how we read data.

A new study proves parachutes are useless
Yeh et al.
  • Scientists working at medical schools across the United States discovered that parachutes don't lower the death rate of people jumping out of airplanes.
  • The study flies in the face of decades of anecdotal evidence.
  • The findings should be carefully applied, due to "minor caveats" with the experimental structure.

There is an old joke that says "If your parachute doesn't deploy, don't worry: you have the rest of your life to fix it." The findings of a new study may put that joke out of fashion, as intrepid scientists found that jumping out of a plane with a parachute didn't lower the death rate of test subjects compared to those who jumped without one.

A leap of faith in anecdotal evidence

The study, published in the light-hearted Christmas edition of BMJ, involved 23 test subjects who were randomly sorted into two groups. One would leap out of an airplane with a parachute while the second would do the same with a regular old backpack. Their survival rates were then compared after they hit the ground. Shockingly, it was found that the rates were the same for both groups!

The authors explained that "Our groundbreaking study found no statistically significant difference in the primary outcome between the treatment and control arms. Our findings should give momentary pause to experts who advocate for routine use of parachutes for jumps from aircraft in recreational or military settings."

What? How!?!

A portion of the flow chart explaining the study structure. As you can see, it follows every regulation for a randomized trial with a control group.

Yeh et al.

In order to get people to agree to take part in the study, the scientists had to structure the experiment properly. The airplane was both on the ground and stationary, as they thought it would be impossible to get people to agree to leap from a moving plane several thousand feet up without a parachute. The authors admit this was a "minor caveat" in the study's design.

They don't admit this until the fourth or fifth paragraph into the paper, however, which leads to their larger point.

Beware of headlines

The authors explain that the whole study was designed to highlight the limitations of randomized trials and the dangers of not reading past the first paragraph of a study. They explain:

"The parachute trial satirically highlights some of the limitations of randomized controlled trials. Nevertheless, we believe that such trials remain the gold standard for the evaluation of most new treatments. The parachute trial does suggest, however, that their accurate interpretation requires more than a cursory reading of the abstract. Rather, interpretation requires a complete and critical appraisal of the study. In addition, our study highlights that studies evaluating devices that are already entrenched in clinical practice face the particularly difficult task of ensuring that patients with the greatest expected benefit from treatment are included during enrollment."

While this study is funny, the questions it raises are real ones. Many influential studies in psychology have been found to be flawed because they used W.E.I.R.D test subjects or were applicable only to a limited range of situations. By clearly showing how accepted procedures can be used to create an absurd little paper, the authors remind us to look closely at the findings of any study.

Admit it, you've read a headline before and then pretended like you read the whole article later when you wanted to talk about it. The point of this silly study is to show just how misleading a summation of a study can be and how important context is in understanding what experiments mean. So have a laugh, and remember to always read more than the study's abstract before you decide to take its supposed findings to heart.

Live on Monday: Does the US need one billion people?

What would happen if you tripled the US population? Matthew Yglesias and moderator Charles Duhigg explore the idea on Big Think Live.

Big Think LIVE

Is immigration key to bolstering the American economy? Could having one billion Americans secure the US's position as the global superpower?

Keep reading Show less

Mystery anomaly weakens Earth's magnetic field, report scientists

A strange weakness in the Earth's protective magnetic field is growing and possibly splitting, shows data.

Satellite data shows a new, eastern center emerging in the South Atlantic Anomaly.

ESA
Surprising Science
  • "The South Atlantic Anomaly" in the Earth's magnetic field is growing and possibly splitting, shows data.
  • The information was gathered by the ESA's Swarm Constellation mission satellites.
  • The changes may indicate the coming reversal of the North and South Poles.
Keep reading Show less

Landau Genius Scale ranking of the smartest physicists ever

How Nobel Prize winner physicist Lev Landau ranked the best physics minds of his generation.

5th International Scientific Congress of Solvay L to r, 3rd row: A.Piccard, E.Henriot, P.Ehrenfest, E.Herzen, T.de Donder,T. Schrodinger, E.Verschaffelt, W.Pauli,, W.Heisenberg, R.H.Fowler, L.Brillouin, 2nd row: .Debye, M.Knudsen, W.L.Bragg, H.A.Kramers, P.A.MDirac, A.H.Compton, L.deBroglie, M.Born, N.Bohr, 1st row: I.Langmuir, M.Planck, Mrs.Curie, H.A.Lorentz, A. Einstein, P.Langevin, C.E.Guye, C.TR.Wilson, O.W.Richardson.

Photo by: Photo12/Universal Images Group via Getty Images
Surprising Science
  • Nobel-Prize-winning Soviet physicist Lev Landau used a scale to rank the best physicists of the 20th century.
  • The physicist based it on their level of contribution to science.
  • The scale was logarithmic, with each level being 10 times more valuable.
  • Keep reading Show less

    Universe works like a cosmological neural network, argues new paper

    Controversial physics theory says reality around us behaves like a computer neural network.

    Synapses in space.

    Credit: sakkmesterke
    Surprising Science
    • Physicist proposes that the universe behaves like an artificial neural network.
    • The scientist's new paper seeks to reconcile classical physics and quantum mechanics.
    • The theory claims that natural selection produces both atoms and "observers".
    Keep reading Show less
    Scroll down to load more…
    Quantcast