What Is the Cause of Soup? Stats Blender Errors.
How "the stats" are being used often causes a fog of low-quality quantification. Multiple regression is widely misunderstood by researchers and journalists.
Jag Bhalla is an entrepreneur, inventor and writer. His current project is Errors We Live By, a series of short exoteric essays exposing errors in the big ideas running our lives, details at www.errorsweliveby.com. His last book was I'm Not Hanging Noodles On Your Ears, a surreptitious science gift book from National Geographic Books, details at www.hangingnoodles.com. That explains his twitter handle @hangingnoodles.
Soup-to-nuts woes can vex “the stats.” Questions about soup show how nuts the situation has gotten.
1. Researchers and journalists are causing a fog of low-quality quantification by reporting data that’s often “somewhere between meaningless and quite damaging,” says Richard Nisbett.
4. Journalists should warn up front that readers are “quite likely to get non-information or misinformation.” Better yet, editors shouldn’t waste reader time.
5. Nesbit blames multiple regression, the standard way to calculate correlations, which is widely misused by “experts” (ditto “statistical significance”).
6. Statistical methods excel with independent factors and unmixed types. Fruitful quantification needs sound qualitative distinctions, or you’re blending apples & oranges (data—>embedded assumptions + metaphors).
7. On average, humans have one testicle + one ovary. Mixed types = iffy stats.
8. Beyond Nesbit’s concerns, what “cause of” means now seems unclear. Biology, the social sciences, and history all need richer concepts of causation than physics (+see Isaiah Berlin’s two kinds of “because”).
10. Does asking, “What is the cause of soup?” make sense? Or what percent is caused by each ingredient? Or what percent of the cause is its recipe? That’s what multiple regression analysis asks.
11. As with soup, so with cancer, or schizophrenia. They’re not homogenous, and don’t have simple causes. Each results from multi-ingredient, multistep processes (their logic can include ... sufficient but not necessary, like many paths to a mountaintop).
12. Such process-dependent composite phenomena can resist quantitative analysis. Again, what percent of the cause of soup is its recipe? It’s inseparable. Meaningless to quantify.
13. Journalists describing a genetic variant that’s “hardly enough to cause schizophrenia; far too many other factors...” cause confusion by also referring to “the cause of schizophrenia” ( ≠ singular cause).
14. Randomized clinical trials are multiple-regression monsters. Their spread beyond medicine risks metaphor errors — e.g., using smartphones is like taking pills. Always consider response types. Is the situation like physics or physiology or history? Billiard balls and kidneys respond consistently. People less so.
15. Aristotle described four kinds of cause: material, formal, proximate, and final. For a table = wood, design, carpenter, and wanting a workspace. Updating Aristotle ... causation can need a recipe.
17. Beyond knowing that correlation ≠ causation, always consider the complexity of “causes.” Not all quantification = useful. Putting all data through the stats blender can be nuts.
Illustration by Julia Suits, The New Yorker Cartoonist & author of The Extraordinary Catalog of Peculiar Inventions.
Entrepreneur and author Andrew Horn shares his rules for becoming an assured conversationalist.
- To avoid basing action on external validation, you need to find your "authentic voice" and use it.
- Finding your voice requires asking the right questions of yourself.
- There are 3-5 questions that you would generally want to ask people you are talking to.
Sarco assisted suicide pods come in three different styles, and allow you to die quickly and painlessly. They're even quite beautiful to look at.
Death: it happens to everyone (except, apparently, Keanu Reeves). But while the impoverished and lower-class people of the world die in the same ol' ways—cancer, heart disease, and so forth—the upper classes can choose hip and cool new ways to die. Now, there's an assisted-suicide pod so chic and so stylin' that peeps (young people still say peeps, right?) are calling it the "Tesla" of death... it's called... the Sarco!
Swiss researchers identify new dangers of modern cocaine.
- Cocaine cut with anti-worming adulterant levamisole may cause brain damage.
- Levamisole can thin out the prefrontal cortex and affect cognitive skills.
- Government health programs should encourage testing of cocaine for purity.
SMARTER FASTER trademarks owned by The Big Think, Inc. All rights reserved.