Big Idea: Statistics About Groups Tell You Nothing About Individuals

Data-mongering is how Americans try to explain or control someone's actions. And yet, statistics about people in general, or about some category of people, tell you nothing certain about any one individual.

Big Idea: Statistics About Groups Tell You Nothing About Individuals

How tall are people, as a rule? If you tried to answer that question by interviewing a seven-foot-tall man, you'd be making a grave mistake. Most any educated person can tell you that a single individual's case won't tell you what to expect about people in general, or people in the same category as that individual. What we don't hear often enough, though, is that this absolute barrier also blocks traffic in the other direction: Statistics about people in general, or about some category of people, tell you nothing certain about any one individual.


To say this is almost heresy in our knowledge-based society. Data-mongering is how Americans try to explain or control someone's actions. As in: Eating like that will give you diabetes. Smacking your kid will make him violent. Taking a walk will make you creative. Being a paranoid schizophrenic will spur you to murder. Haven't you seen the news? Studies show!

To see why this is wrong, think about an insurance company contemplating the great American highway. Those actuaries estimate roughly 30,000 people will be killed in U.S. traffic accidents every year. That's reliable knowledge, gathered by sound methods. But it doesn't allow them to state the name and address of any particular future victim. Medical research faces the same barrier: I can tell you that people who smoke a pack a day are more likely to develop lung cancer than people who don't. I can't say that means for sure that you, with your pack-a-day habit, are going to get lung cancer (some smokers, after all, never do).

Moreover, if you do get lung cancer after my warning, I cannot come to you and say, "you see, the statistical analysis foresaw what would happen to you." Because it didn't. Instead, it told you about the quality (not good) of the bet you were making with your life. It predicted with some confidence that at some future time the group of smokers who beat the odds would be way smaller than the group who failed to do so. That analysis not "wrong" if you never get cancer, or "right" if you end up getting sick. Which group you happened to land in is irrelevant.

Contrast this with the story of your life, as you might tell it near its end. Retrospectively, either outcome—you getting sick, crushed as you were by the odds, or, you beating those odds—would feel inevitable. How could your personal history, those unique memories that shaped you, have turned out any other way? If you had a different history, after all, you wouldn't be you.

Stories—including, of course, the autobiographies we tell ourselves—are about individuals and the things that certainly did and did not happen to them. This means that stories are backward-looking: The only events of which we are absolutely sure are those that have already occurred. Statistical predictions, though, are about groups, and the things that might happen to them, and the hidden connections among those things. Statistical efforts are forward-looking. They ask: What is likely to happen in the future? Or, What would happen in the future if this hypothesis were true? These two modes of thinking about experience are truly incompatible.

Yet we persist in trying to turn statistically-based estimates about future results into narratives. The human mind is honed to pay attention to other people's experiences and feelings, so those details impress us in a way that numbers don't. And there's a good case for the assertion that we evolved to understand the world by narrative means. So people who want to make statistical points about people in general will instinctively brighten up their picture with some compelling story—either hypothetical (imagine a 20-year-old schizophrenic being cared for by a demented old father!) or concrete (this guy had a leg amputated due to diabetes!). These tales are supposed to act as an illustration of a statistically-based argument. In the first, it's "you should have children earlier in life than you imagine"; in the second, it's "you should drink and eat less sugar."

Trouble is, stories are so compelling that they work too well. What is supposed to act as an illustration of a general case feels like a prophecy—an edict declaring how your own personal narrative will read some day in the future. The story captured your attention and your emotions, which makes it easy to think about again, which makes it feel more probable (in a phenomenon psychologists call the availability heuristic, what comes to mind easily is deemed more likely than what doesn't, regardless of real odds). So this dreadful future, which might happen to you, according to the best analysis we can make right now, feels as if it will happen to you, with the certainty of a movie plot.

Marketers and political types and journalists like me don't really set out to confuse. We're just doing what works, attaching tales to numbers, because that gets the number-based facts across. But part of our craft depends on the false impression that numbers and narratives are compatible. For instance, take the first of my two examples above. It's taken from Judith Shulevitz's terrific recent piece in The New Republic on the largely unrecognized effects of people having children later in their lives than ever. As Shulevitz recounts, being an older mother (or an older father, a point she rightly stresses because it hasn't yet become part of the national conversation) correlates with a higher risk of having a child with autism, schizophrenia or chromosomal abnormalities. Hence the image, recounted by one of her sources, of the schizophrenic young adult with the father too old and feeble to step and provide needed help.

As an observation about society in general, the well-reported point here is hard to contest. Society as a whole should prepare for an uptick in the number of young people with learning problems, autism and schizophrenia. But does this mean that any single reader of the article should decide to have a child ten years earlier than planned? Or that a 40-something reader should decide against having offspring? Well, according to one study cited in the piece, a man has a 6-in-10,000 chance of fathering an autistic child before age 30, but a 32-in-10,000 chance of doing so when he's 40. That's a big jump, but still: A very small number multiplied by another number results in a very small number. And a little Googling reveals that 30-in-10,000 is also the estimated risk in the United States of having a heart attack if you are a menopausal woman or of simply dropping dead at age 55.

In other words, while it's true as a general observation that older parents will have more children with behavioral problems, it would be a mistake for any individual person to decide that they're going to have this problem. The odds are vastly against that fate. Being able to imagine it happening to you, or knowing that it has happened to someone else, has no effect on those odds. Such is the difficulty of connecting statistics about whole populations to any one person's story, in fact, that the amputee in my second example, from a New York City public health campaign, had to be created in Photoshop.

Where ancient peoples had gods and heroes and medieval Europeans had the lives of saints, we 21st-century citizens have the normal distribution: To find out what we should do and be, we turn to data. If the statistics come from solid research, they have important information for us about how we, as a nation, are faring. But they aren't prophecies, and your individual life—that string of wildly improbable events that began with your conception on one particular night—remains a story that no body of data can predict.

 ADDENDUM 12/30/12: Thinking a bit more about this post, I realized that something else was nagging at me about the argument that Shulevitz wants to build on her impeccable reporting. It seems to me it's quite relevant to the theme here.

She's quite correct in saying older parenthood is a vast "natural experiment" that the human race is conducting on itself. However, part of what makes that claim effective is narrative power: The announcement of a scary natural experiment rivets the attention and engenders some fear. However, the piece doesn't mention (because it would weaken its rhetorical impact, I guess) that we have been engaged in vast natural experiments with fertility for two centuries. In other words, to be an effective piece of writing, it implies that we have existed in a state of natural balance and health, only now disturbing it. But the reality is that there is no logical reason to claim that today's experiment is unique, or uniquely bad.

What are some of these other natural experiments? Well, there was the one where much of the human population stopped being at the edge of starvation. And the one where major improvements in sanitation led to (a) parents seeing all their children live to adulthood and (b) adults commonly having one or more living parents and (c) millions living long enough to be active grandparents. Neither (a) nor (b) nor (c) would have seemed normal to most of our ancestors. (By the way, (a) is often cited as the prime driver of another great natural experiment, the plummeting rate of births-per-woman all over the world.)

Shulevitz says adults still need their parents and that children do better with sturdy grandparents, which (to my eye, anyway) implies that this is the human norm. That is narratively effective ("something is menacing the natural order of things") but not supported by the evidence (which tells us that "normal" for much of human history was to live to perhaps 40 or 50, and see a good number of your infant offspring die. It's factually wrong to suggest that we are, only now in the 21st century, deviating from the natural life-cycles of the species. But as a way of telling the story, it's almost irresistible to a good writer.

Illustration: Medieval statistical thinking: Kings and clerics and peasants go up and down in life according to the spin of Fortune's wheel.

Follow me on Twitter: @davidberreby

Live on Monday: Does the US need one billion people?

What would happen if you tripled the US population? Join Matthew Yglesias and Charles Duhigg at 1pm ET on Monday, September 28.

A landslide is imminent and so is its tsunami

An open letter predicts that a massive wall of rock is about to plunge into Barry Arm Fjord in Alaska.

Image source: Christian Zimmerman/USGS/Big Think
Surprising Science
  • A remote area visited by tourists and cruises, and home to fishing villages, is about to be visited by a devastating tsunami.
  • A wall of rock exposed by a receding glacier is about crash into the waters below.
  • Glaciers hold such areas together — and when they're gone, bad stuff can be left behind.

The Barry Glacier gives its name to Alaska's Barry Arm Fjord, and a new open letter forecasts trouble ahead.

Thanks to global warming, the glacier has been retreating, so far removing two-thirds of its support for a steep mile-long slope, or scarp, containing perhaps 500 million cubic meters of material. (Think the Hoover Dam times several hundred.) The slope has been moving slowly since 1957, but scientists say it's become an avalanche waiting to happen, maybe within the next year, and likely within 20. When it does come crashing down into the fjord, it could set in motion a frightening tsunami overwhelming the fjord's normally peaceful waters .

"It could happen anytime, but the risk just goes way up as this glacier recedes," says hydrologist Anna Liljedahl of Woods Hole, one of the signatories to the letter.

The Barry Arm Fjord

Camping on the fjord's Black Sand Beach

Image source: Matt Zimmerman

The Barry Arm Fjord is a stretch of water between the Harriman Fjord and the Port Wills Fjord, located at the northwest corner of the well-known Prince William Sound. It's a beautiful area, home to a few hundred people supporting the local fishing industry, and it's also a popular destination for tourists — its Black Sand Beach is one of Alaska's most scenic — and cruise ships.

Not Alaska’s first watery rodeo, but likely the biggest

Image source: whrc.org

There have been at least two similar events in the state's recent history, though not on such a massive scale. On July 9, 1958, an earthquake nearby caused 40 million cubic yards of rock to suddenly slide 2,000 feet down into Lituya Bay, producing a tsunami whose peak waves reportedly reached 1,720 feet in height. By the time the wall of water reached the mouth of the bay, it was still 75 feet high. At Taan Fjord in 2015, a landslide caused a tsunami that crested at 600 feet. Both of these events thankfully occurred in sparsely populated areas, so few fatalities occurred.

The Barry Arm event will be larger than either of these by far.

"This is an enormous slope — the mass that could fail weighs over a billion tonnes," said geologist Dave Petley, speaking to Earther. "The internal structure of that rock mass, which will determine whether it collapses, is very complex. At the moment we don't know enough about it to be able to forecast its future behavior."

Outside of Alaska, on the west coast of Greenland, a landslide-produced tsunami towered 300 feet high, obliterating a fishing village in its path.

What the letter predicts for Barry Arm Fjord

Moving slowly at first...

Image source: whrc.org

"The effects would be especially severe near where the landslide enters the water at the head of Barry Arm. Additionally, areas of shallow water, or low-lying land near the shore, would be in danger even further from the source. A minor failure may not produce significant impacts beyond the inner parts of the fiord, while a complete failure could be destructive throughout Barry Arm, Harriman Fiord, and parts of Port Wells. Our initial results show complex impacts further from the landslide than Barry Arm, with over 30 foot waves in some distant bays, including Whittier."

The discovery of the impeding landslide began with an observation by the sister of geologist Hig Higman of Ground Truth, an organization in Seldovia, Alaska. Artist Valisa Higman was vacationing in the area and sent her brother some photos of worrying fractures she noticed in the slope, taken while she was on a boat cruising the fjord.

Higman confirmed his sister's hunch via available satellite imagery and, digging deeper, found that between 2009 and 2015 the slope had moved 600 feet downhill, leaving a prominent scar.

Ohio State's Chunli Dai unearthed a connection between the movement and the receding of the Barry Glacier. Comparison of the Barry Arm slope with other similar areas, combined with computer modeling of the possible resulting tsunamis, led to the publication of the group's letter.

While the full group of signatories from 14 organizations and institutions has only been working on the situation for a month, the implications were immediately clear. The signers include experts from Ohio State University, the University of Southern California, and the Anchorage and Fairbanks campuses of the University of Alaska.

Once informed of the open letter's contents, the Alaska's Department of Natural Resources immediately released a warning that "an increasingly likely landslide could generate a wave with devastating effects on fishermen and recreationalists."

How do you prepare for something like this?

Image source: whrc.org

The obvious question is what can be done to prepare for the landslide and tsunami? For one thing, there's more to understand about the upcoming event, and the researchers lay out their plan in the letter:

"To inform and refine hazard mitigation efforts, we would like to pursue several lines of investigation: Detect changes in the slope that might forewarn of a landslide, better understand what could trigger a landslide, and refine tsunami model projections. By mapping the landslide and nearby terrain, both above and below sea level, we can more accurately determine the basic physical dimensions of the landslide. This can be paired with GPS and seismic measurements made over time to see how the slope responds to changes in the glacier and to events like rainstorms and earthquakes. Field and satellite data can support near-real time hazard monitoring, while computer models of landslide and tsunami scenarios can help identify specific places that are most at risk."

In the letter, the authors reached out to those living in and visiting the area, asking, "What specific questions are most important to you?" and "What could be done to reduce the danger to people who want to visit or work in Barry Arm?" They also invited locals to let them know about any changes, including even small rock-falls and landslides.

Learn innovation with 3-star Michelin chef Dominique Crenn

Dominique Crenn, the only female chef in America with three Michelin stars, joins Big Think Live.

Big Think LIVE

Having been exposed to mavericks in the French culinary world at a young age, three-star Michelin chef Dominique Crenn made it her mission to cook in a way that is not only delicious and elegant, but also expressive, memorable, and true to her experience.

Keep reading Show less

Ultracold gas exhibits bizarre quantum behavior

New experiments find weird quantum activity in supercold gas.

Credit: Pixabay
Surprising Science
  • Experiments on an ultracold gas show strange quantum behavior.
  • The observations point to applications in quantum computing.
  • The find may also advance chaos theory and explain the butterfly effect.
  • Keep reading Show less

    3 cognitive biases perpetuating racism at work — and how to overcome them

    Researchers say that moral self-licensing occurs "because good deeds make people feel secure in their moral self-regard."

    Photo by Christina @ wocintechchat.com on Unsplash
    Personal Growth

    Books about race and anti-racism have dominated bestseller lists in the past few months, bringing to prominence authors including Ibram Kendi, Ijeoma Oluo, Reni Eddo-Lodge, and Robin DiAngelo.

    Keep reading Show less
    Scroll down to load more…
    Quantcast