Algorithms associating appearance and criminality have a dark past
We'd like to think that judging people's worth based on the shape of their head is a practice that's behind us.
'Phrenology' has an old-fashioned ring to it. It sounds like it belongs in a history book, filed somewhere between bloodletting and velocipedes.
We'd like to think that judging people's worth based on the size and shape of their skull is a practice that's well behind us. However, phrenology is once again rearing its lumpy head.
In recent years, machine-learning algorithms have promised governments and private companies the power to glean all sorts of information from people's appearance. Several startups now claim to be able to use artificial intelligence (AI) to help employers detect the personality traits of job candidates based on their facial expressions. In China, the government has pioneered the use of surveillance cameras that identify and track ethnic minorities. Meanwhile, reports have emerged of schools installing camera systems that automatically sanction children for not paying attention, based on facial movements and microexpressions such as eyebrow twitches.
Perhaps most notoriously, a few years ago, AI researchers Xiaolin Wu and Xi Zhang claimed to have trained an algorithm to identify criminals based on the shape of their faces, with an accuracy of 89.5 per cent. They didn't go so far as to endorse some of the ideas about physiognomy and character that circulated in the 19th century, notably from the work of the Italian criminologist Cesare Lombroso: that criminals are underevolved, subhuman beasts, recognisable from their sloping foreheads and hawk-like noses. However, the recent study's seemingly high-tech attempt to pick out facial features associated with criminality borrows directly from the 'photographic composite method' developed by the Victorian jack-of-all-trades Francis Galton – which involved overlaying the faces of multiple people in a certain category to find the features indicative of qualities like health, disease, beauty and criminality.
Technology commentators have panned these facial-recognition technologies as 'literal phrenology'; they've also linked it to eugenics, the pseudoscience of improving the human race by encouraging people deemed the fittest to reproduce. (Galton himself coined the term 'eugenics', describing it in 1883 as 'all influences that tend in however remote a degree to give to the more suitable races or strains of blood a better chance of prevailing speedily over the less suitable than they otherwise would have had'.)
In some cases, the explicit goal of these technologies is to deny opportunities to those deemed unfit; in others, it might not be the goal, but it's a predictable result. Yet when we dismiss algorithms by labelling them as phrenology, what exactly is the problem we're trying to point out? Are we saying that these methods are scientifically flawed and that they don't really work – or are we saying that it's morally wrong to use them regardless?
There is a long and tangled history to the way 'phrenology' has been used as a withering insult. Philosophical and scientific criticisms of the endeavour have always been intertwined, though their entanglement has changed over time. In the 19th century, phrenology's detractors objected to the fact that phrenology attempted to pinpoint the location of different mental functions in different parts of the brain – a move that was seen as heretical, since it called into question Christian ideas about the unity of the soul. Interestingly, though, trying to discover a person's character and intellect based on the size and shape of their head wasn't perceived as a serious moral issue. Today, by contrast, the idea of localising mental functions is fairly uncontroversial. Scientists might no longer think that destructiveness is seated above the right ear, but the notion that cognitive functions can be localised in particular brain circuits is a standard assumption in mainstream neuroscience.
Phrenology had its share of empirical criticism in the 19th century, too. Debates raged about which functions resided where, and whether skull measurements were a reliable way of determining what's going on in the brain. The most influential empirical criticism of old phrenology, though, came from the French physician Jean Pierre Flourens's studies based on damaging the brains of rabbits and pigeons – from which he concluded that mental functions are distributed, rather than localised. (These results were later discredited.) The fact that phrenology was rejected for reasons that most contemporary observers would no longer accept makes it only more difficult to figure out what we're targeting when we use 'phrenology' as a slur today.
Both 'old' and 'new' phrenology have been critiqued for their sloppy methods. In the recent AI study of criminality, the data were taken from two very different sources: mugshots of convicts, versus pictures from work websites for nonconvicts. That fact alone could account for the algorithm's ability to detect a difference between the groups. In a new preface to the paper, the researchers also admitted that taking court convictions as synonymous with criminality was a 'serious oversight'. Yet equating convictions with criminality seems to register with the authors mainly as an empirical flaw: using mugshots of convicted criminals, but not of the ones who got away introduces a statistical bias. They said they were 'deeply baffled' at the public outrage in reaction to a paper that was intended 'for pure academic discussions'.
From Wu and Zhang (2016)
Notably, the researchers don't comment on the fact that conviction itself depends on the impressions that police, judges and juries form of the suspect – making a person's 'criminal' appearance a confounding variable. They also fail to mention how the intense policing of particular communities, and inequality of access to legal representation, skews the dataset. In their response to criticism, the authors don't back down on the assumption that 'being a criminal requires a host of abnormal (outlier) personal traits'. Indeed, their framing suggests that criminality is an innate characteristic, rather than a response to social conditions such as poverty or abuse. Part of what makes their dataset questionable on empirical grounds is that who gets labelled 'criminal' is hardly value-neutral.
One of the strongest moral objections to using facial recognition to detect criminality is that it stigmatises people who are already overpoliced. The authors say that their tool should not be used in law-enforcement, but cite only statistical arguments about why it ought not to be deployed. They note that the false-positive rate (50 per cent) would be very high, but take no notice of what that means in human terms. Those false positives would be individuals whose faces resemble people who have been convicted in the past. Given the racial and other biases that exist in the criminal justice system, such algorithms would end up overestimating criminality among marginalised communities.
The most contentious question seems to be whether reinventing physiognomy is fair game for the purposes of 'pure academic discussion'. One could object on empirical grounds: eugenicists of the past such as Galton and Lombroso ultimately failed to find facial features that predisposed a person to criminality. That's because there are no such connections to be found. Likewise, psychologists studying the heritability of intelligence, such as Cyril Burt and Philippe Rushton, had to play fast and loose with their data to manufacture correlations between skull size, race and IQ. If there were anything to discover, presumably the many people who have tried over the years wouldn't have come up dry.
The problem with reinventing physiognomy is not merely that it has been tried without success before. Researchers who persist in looking for cold fusion after the scientific consensus has moved on also face criticism for chasing unicorns – but disapproval of cold fusion falls far short of opprobrium. At worst, they are seen as wasting their time. The difference is that the potential harms of cold fusion research are much more limited. In contrast, some commentators argue that facial recognition should be regulated as tightly as plutonium, because it has so few nonharmful uses. When the dead-end project you want to resurrect was invented for the purpose of propping up colonial and class structures – and when the only thing it's capable of measuring is the racism inherent in those structures – it's hard to justify trying it one more time, just for curiosity's sake.
However, calling facial-recognition research 'phrenology' without explaining what is at stake probably isn't the most effective strategy for communicating the force of the complaint. For scientists to take their moral responsibilities seriously, they need to be aware of the harms that might result from their research. Spelling out more clearly what's wrong with the work labelled 'phrenology' will hopefully have more of an impact than simply throwing the name around as an insult.
- The New Horizon of Neuroscience - Big Think ›
- The Shape of Your Face May Predict Your Sex Drive, Study Finds ... ›
What would happen if you tripled the US population? Join Matthew Yglesias and Charles Duhigg at 1pm ET on Monday, September 28.
The idea of 'absolute time' is an illusion. Physics and subjective experience reveal why.
- Since Einstein posited his theory of general relativity, we've understood that gravity has the power to warp space and time.
- This "time dilation" effect occurs even at small levels.
- Outside of physics, we experience distortions in how we perceive time — sometimes to a startling extent.
Physics without time<p>In his book "The Order of Time," Italian theoretical physicist Carlo Rovelli suggests that our perception of time — our sense that time is forever flowing forward — could be a highly subjective projection. After all, when you look at reality on the smallest scale (using equations of quantum gravity, at least), time vanishes.</p><p style="margin-left: 20px;">"If I observe the microscopic state of things," writes Rovelli, "then the difference between past and future vanishes … in the elementary grammar of things, there is no distinction between 'cause' and 'effect.'"</p><p>So, why do we perceive time as flowing <em>forward</em>? Rovelli notes that, although time disappears on extremely small scales, we still obviously perceive events occur sequentially in reality. In other words, we observe entropy: Order changing into disorder; an egg cracking and getting scrambled.</p><p>Rovelli says key aspects of time are described by the second law of thermodynamics, which states that heat always passes from hot to cold. This is a one-way street. For example, an ice cube melts into a hot cup of tea, never the reverse. Rovelli suggests a similar phenomenon might explain why we're only able to perceive the past and not the future.</p><p style="margin-left: 20px;">"Any time the future is definitely distinguishable from the past, there is something like heat involved," Rovelli wrote for the <a href="https://www.ft.com/content/ce6ef7b8-429a-11e8-93cf-67ac3a6482fd" target="_blank"><em>Financial Times</em></a>. "Thermodynamics traces the direction of time to something called the 'low entropy of the past', a still mysterious phenomenon on which discussions rage."</p>
The strange subjectivity of time<p>Time moves differently atop a mountain than it does on a beach. But you don't need to travel any distance at all to experience strange distortions in your perception of time. In moments of life-or-death fear, for example, your brain would release large amounts of adrenaline, which would speed up your internal clock, causing you to perceive the outside world as moving slowly.<br></p><p>Another common distortion occurs when we focus our attention in particular ways.</p><p style="margin-left: 20px;">"If you're thinking about how time is <em>currently</em> passing by, the biggest factor influencing your time perception is attention," Aaron Sackett, associate professor of marketing at the University of St. Thomas, told <em><a href="https://gizmodo.com/why-does-time-slow-down-and-speed-up-1840133782" target="_blank">Gizmodo</a></em>.<em> "</em>The more attention you give to the passage of time, the slower it tends to go. As you become distracted from time's passing—perhaps by something interesting happening nearby, or a good daydreaming session—you're more likely to lose track of time, giving you the feeling that it's slipping by more quickly than before. "Time flies when you're having fun," they say, but really, it's more like "time flies when you're thinking about other things." That's why time will also often fly by when you're definitely <em>not</em> having fun—like when you're having a heated argument or are terrified about an upcoming presentation."</p><p>One of the most mysterious ways people experience time-perception distortions is through psychedelic drugs. In an interview with <a href="https://www.theguardian.com/books/2018/apr/14/carlo-rovelli-exploding-commonsense-notions-order-of-time-interview" target="_blank"><em>The Guardian</em></a>, Rovelli described a time he experimented with LSD.</p><p style="margin-left: 20px;">"It was an extraordinarily strong experience that touched me also intellectually," he said. "Among the strange phenomena was the sense of time stopping. Things were happening in my mind but the clock was not going ahead; the flow of time was not passing any more. It was a total subversion of the structure of reality."<br></p><p>It seems few scientists or philosophers believe time is completely an illusion.</p><p style="margin-left: 20px;">"What we call <em>time</em> is a rich, stratified concept; it has many layers," Rovelli told <em><a href="https://physicstoday.scitation.org/do/10.1063/PT.6.4.20190219a/full/" target="_blank">Physics Today</a>.</em> "Some of time's layers apply only at limited scales within limited domains. This does not make them illusions."</p>What <em>is</em> an illusion is the idea that time flows at an absolute rate. The river of time might be flowing forever forward, but it moves at different speeds, between people, and even within your own mind.
Dominique Crenn, the only female chef in America with three Michelin stars, joins Big Think Live.
Having been exposed to mavericks in the French culinary world at a young age, three-star Michelin chef Dominique Crenn made it her mission to cook in a way that is not only delicious and elegant, but also expressive, memorable, and true to her experience.
Controversial physics theory says reality around us behaves like a computer neural network.
- Physicist proposes that the universe behaves like an artificial neural network.
- The scientist's new paper seeks to reconcile classical physics and quantum mechanics.
- The theory claims that natural selection produces both atoms and "observers".
Vanchurin interview:<span style="display:block;position:relative;padding-top:56.25%;" class="rm-shortcode" data-rm-shortcode-id="539759cbfd8fcd5b6ebf14a3b597b3f9"><iframe type="lazy-iframe" data-runner-src="https://www.youtube.com/embed/bmyRy2-UhEE?rel=0" width="100%" height="auto" frameborder="0" scrolling="no" style="position:absolute;top:0;left:0;width:100%;height:100%;"></iframe></span>
Vanchurin on “Hidden Phenomena”:<span style="display:block;position:relative;padding-top:56.25%;" class="rm-shortcode" data-rm-shortcode-id="18886ffd5e5840bb19d4494212f88d82"><iframe type="lazy-iframe" data-runner-src="https://www.youtube.com/embed/2NDVdNwsHCo?rel=0" width="100%" height="auto" frameborder="0" scrolling="no" style="position:absolute;top:0;left:0;width:100%;height:100%;"></iframe></span>Vitaly Vanchurin speaking at the 6th International FQXi Conference, "Mind Matters: Intelligence and Agency in the Physical World." The Foundational Questions...
43% of people think they can get a sense of someone's personality by their picture.
If you've used a dating app, you'll know the importance of choosing good profile pics.
Quarantine rule breakers in 17th-century Italy partied all night – and some clergy condemned the feasting
17th-century outbreaks of plague in Italy reveal both tensions between religious and public health authorities.