Confirmation Bias Isn’t a Bug, It’s Operator Error

A key cognitive bias isn’t a bug, it’s just operator error (and easily correctable by using reason as nature intended).

Illustration by Julia Suits, The New Yorker cartoonist & author of The Extraordinary Catalog of Peculiar Inventions
Illustration by Julia Suits, The New Yorker cartoonist & author of The Extraordinary Catalog of Peculiar Inventions


1. Science has good news on minds, for a change. A key cognitive bias isn’t a bug, it’s just operator error (and easily correctable by using reason as nature intended).

2. In The Enigma of Reason, Hugo Mercier and Dan Sperber (M&S), articulate an “argumentative theory of reasoning.” Their “interactionist” views contrast sharply from the prevailing individualist “intellectualism.”

3. M&S call confirmation bias—discounting facts that contradict your beliefs—a “well-established but ill-explained” pattern which actually has evolutionary advantages.

4. An analogy between reason and sight can enlighten here. Eyesight isn’t a direct window onto reality. It detects limited wavelengths, needs many interpretative steps between received light and sight, and suffers optical illusions (that are tellingly not survival-threatening).

5. Likewise, reason isn’t an all-seeing, impartial, objective logic machine (roughly what intellectualist Enlightenment reason-lovers like Descartes and Kant believed).

6. Our brains are built and “biased” to enable evolutionarily useful behaviors. And solving abstract logic problems is an evolutionary novelty (e.g., only possible after the invention of the technology of writing). So reason evolved mainly “to resolve the problems posed by living in collaborative groups.”

7. M&S argue that reason’s two main functions, self-justification and persuasion, are tools “for social action.”

8. But, they emphasize, there’s no evolutionary sense in being predisposed to pigheadedly sticking to your beliefs. You’re often better off changing your mind and using better ideas from trusted others (cognitive division of labor). So we evolved to be persuadable (by sufficiently good, trustworthy, reasons), as M&S describe in chapter 15 “The Bright Side of Reason.”

9. M&S’s argumentative theory is often misrepresented as reason being like your inner lawyer’s win-at-all-costs “weapon.” But good lawyers know when to concede to stronger arguments. They negotiate in their clients’ better interests.

10. And M&S say we have two inner lawyers, one very vigilant about reasons given by others, another lazy one arguing our side (with a sensible laziness)

11. Not thinking too hard about your first justification and relying on the “epistemic vigilance” of co-reasoners is often a good division of “cognitive labor,” that efficiently generates better decisions (= clearly adaptive, if you can avoid being manipulated or misinformed).

12. We’re well adapted for collective reasoning (unavoidably cooperative, self-deficient lives). And cognitive individualism is a recent, incoherent idea.

13. There’s much more in The Enigma of Reason (e.g., intuition’s role in all reasoning, or countering “dual systems” views, see Kahneman). And more work is needed (e.g. on trust, power, and intuition-shifting processes) but M&S’s work—perhaps better called the “negotiative theory of reasoning” or “social theory of reasoning”— represents progress.

14. Individualist Enlightenment thinkers mostly haven’t enlightened us about our inalienably social minds. Rather, the “Age of Reason” has tended to promote unempirical, unevolutionary, over-rationalist, over-individualist thinking (=delusions).

15. Clearer thinkers aren’t blinkered by the aspirational projections of solitary geniuses. They see how extensive cognitive division of labor, and reliance on the minds of others, means we exceed the capabilities of our individual minds.

 

Illustration by Julia SuitsThe New Yorker cartoonist & author of The Extraordinary Catalog of Peculiar Inventions

What early US presidents looked like, according to AI-generated images

"Deepfakes" and "cheap fakes" are becoming strikingly convincing — even ones generated on freely available apps.

Abraham Lincoln, George Washington

Magdalene Visaggio via Twitter
Technology & Innovation
  • A writer named Magdalene Visaggio recently used FaceApp and Airbrush to generate convincing portraits of early U.S. presidents.
  • "Deepfake" technology has improved drastically in recent years, and some countries are already experiencing how it can weaponized for political purposes.
  • It's currently unknown whether it'll be possible to develop technology that can quickly and accurately determine whether a given video is real or fake.
Keep reading Show less

Catacombs of Paris: The city of darkness finds its new raison d'être

Ancient corridors below the French capital have served as its ossuary, playground, brewery, and perhaps soon, air conditioning.

Excerpt from a 19th century map of the Paris Catacombs, showing the labyrinthine layout underground (in color) beneath the straight-lined structures on the surface (in grey).

Credit: Inspection Générale des Carrières, 1857 / Public domain
Strange Maps
  • People have been digging up limestone and gypsum from below Paris since Roman times.
  • They left behind a vast network of corridors and galleries, since reused for many purposes — most famously, the Catacombs.
  • Soon, the ancient labyrinth may find a new lease of life, providing a sustainable form of air conditioning.
Keep reading Show less

Baby's first poop predicts risk of allergies

Meconium contains a wealth of information.

Surprising Science
  • A new study finds that the contents of an infants' first stool, known as meconium, can predict if they'll develop allergies with a high degree of accuracy.
  • A metabolically diverse meconium, which indicates the initial food source for the gut microbiota, is associated with fewer allergies.
  • The research hints at possible early interventions to prevent or treat allergies just after birth.
Keep reading Show less
Mind & Brain

Big think: Will AI ever achieve true understanding?

If you ask your maps app to find "restaurants that aren't McDonald's," you won't like the result.

Quantcast