Can the "Lesbian Rule" Fight Weaponized Math?
Reviving the “Lesbian Rule” (which Aristotle wrote about, and was proverbial in Shakespeare's day) can help us handle a new kind of weaponized-math threat (that Cathy O’Neil calls “Weapons of Math Destruction”).
Jag Bhalla is an entrepreneur, inventor and writer. His current project is Errors We Live By, a series of short exoteric essays exposing errors in the big ideas running our lives, details at www.errorsweliveby.com. His last book was I'm Not Hanging Noodles On Your Ears, a surreptitious science gift book from National Geographic Books, details at www.hangingnoodles.com. That explains his twitter handle @hangingnoodles.
2. O’Neil exposes software models as digital deciders that can be “opaque… and uncontestable (sic), even when they’re wrong” (a new kind of kinetic logic threat).
3. Aristotle believed laws can be “defective because of... generality.” So equity can “only be measured… like the leaden rule used by Lesbian builders… that rule is not rigid but can bend to the shape of the stone.” (Until ~1870 Lesbian didn’t mean female homosexual.)
5. Shakespeare pondered distinctions between justice, equity, and equality. See “The Lesbian Rule of Measure for Measure’s” inflexible rules, King Lear’s “social arithmetics,” or “false equality” and erring quantitative equations in The Tempest.
6. In our math-intoxicated times we’re often at the mercy of the rigid-ruled robo-judgments of algorithms. O’Neil details their math-driven harms across fields like finance, education, justice, and democracy.
7. Models and metrics seemingly offer objective and fair judgements, but they often encode “prejudice, misunderstanding, and bias.” And predictive models can perpetuate injustice (e.g., algorithmic discrimination in sentencing and recidivism models).
8. And metrics can distort—>what gets measured often gets gamed. For instance, one university instantly improved its research rating by paying adjuncts $72,000 for 3 weeks of teaching if they reassigned old research to their new university.
9. Plus, much resists quantification. For instance, hammering all the complexity of good teaching into one number risks being “a statistical farce” (e.g. this New York Public School teacher rating seesawed wildly).
11. Sometimes the smart-seeming move of focussing on the metrics and the math, misleads. What math-mesmerized experts forget is that not all logic works like math (here’s an example of locally valid steps not logically accumulating like math overall).
13. Lesbian Rule thinking now means asking: Is all the needed truth in the data? Are the relevant realities squeezed into the model’s rules? Biases countered? Exceptions handled? Redress enabled?
14. Per Aristotle, legal codes have long encoded the need for judges to tailor justice (situationally, equitably). Legal norms (mitigation, recourse, conflict-of-interest avoidance) provide good models for algo-ethics (aside: lawyers are among the few still trained in non-numeric logic).
16. O’Neil says putting “fairness ahead of profit” means explicitly embedding “better values into our algorithms" (+using audits, transparency, hippocratic oaths).
17. Algorithms offer great gains and efficiencies, but these rigid-ruled robo-judges are also clear and present dangers. We court disaster if justice remains blind to their systemic risks.
Illustration by Julia Suits, The New Yorker cartoonist & author of The Extraordinary Catalog of Peculiar Inventions
NASA astronomer Michelle Thaller is coming back to Big Think to answer YOUR questions! Here's all you need to know to submit your science-related inquiries.
Big Think's amazing audience has responded so well to our videos from NASA astronomer and Assistant Director for Science Communication Michelle Thaller that we couldn't wait to bring her back for more!
And this time, she's ready to tackle any questions you're willing to throw at her, like, "How big is the Universe?", "Am I really made of stars?" or, "How long until Elon Musk starts a colony on Mars?"
All you have to do is submit your questions to the form below, and we'll use them for an upcoming Q+A session with Michelle. You know what to do, Big Thinkers!
Or how I learned to stop worrying and love my tsundoku.
- Many readers buy books with every intention of reading them only to let them linger on the shelf.
- Statistician Nassim Nicholas Taleb believes surrounding ourselves with unread books enriches our lives as they remind us of all we don't know.
- The Japanese call this practice tsundoku, and it may provide lasting benefits.
Calling all big thinkers!
SMARTER FASTER trademarks owned by The Big Think, Inc. All rights reserved.