Once a week.
Subscribe to our weekly newsletter.
Would companies be more diverse if A.I. did the hiring?
The best hiring manager might just be the computer sitting on your desk, says AI expert Joanna Bryson.
Joanna Bryson: Can AI remove implicit bias from the hiring process? “Remove”, entirely remove? No.
But as I understand I've had multiple people tell me that it's already reducing the impact of implicit bias, so they're already happy with what they're seeing.
So what is implicit bias, first of all? It's important to understand that implicit bias and explicit bias are two different things.
Implicit bias is stuff that you're not conscious of; you're not aware of it; it's hard for you to control; it's probably impossible for you to control.
It's impossible for you to control, right now, on demand. You might be able to alter it by exposing yourself to different situations or whatever and changing what we in machine learning call priors—so changing your experiences.
So maybe if you see more women in senior positions you'll become less implicitly sexist, or something like that.
But anyway, explicit bias is like “I’m going to choose to only work with women” or “I’m going to choose only to work with men” and I know that and I'm conscious about it.
So HR departments are reasonably good at getting people who hopefully honestly are saying “yeah I'm not going to be racist or sexist or whatever-ist, I'm not going to worry about how long somebody's name is or what the country of origin of someone of their ancestors is.” So hopefully HR people can spot the people who sincerely are neutral, at least at the explicit level.
But at the implicit level, there's a lot of evidence that something else might be going on. Again, we don't know for sure if it's implicit or explicit, but what we do know is that in the paper we did in 2017 one of my co-authors Aylin Caliskan had this brilliant idea of looking at the resume data. So there's this famous study that showed that you have identical resumes and the only thing you do is have more African-American names versus European American names, and the people with European American names get 50 percent more calls in to interview with nothing else changed.
And so now people are talking about “whitening” their CVs just so they get that chance to interview. So anyway, it looks by the measures that we used with the vector spaces as if the data and the implicit bias that also explains implicit bias also explains those choices on the resume.
So does that mean people are looking at it and explicitly saying, “Oh I think that's an African-American?” Or were they just going through huge stacks of CVs and some didn't jump out at them in the same ways that others did? Because we're pretty sure when it comes down to like they're all sitting in the room together that that point was okay.
And so what the AI is doing for them is it's helping them pick out the characteristics they're looking for and ignoring the other characteristics. So they're helping them detect the things that they wanted to be: when they were sitting in the room with multiple eyes looking at something, that they were looking at the right starting place and then they're able to find - they're finding people that were falling through the cracks.
A lot of people have trouble, that there's not enough good people applying or that they thought there weren't enough good people applying, but actually, they were missing people because they didn't see the qualifications buried in the other stuff when they're leafing through these stacks.
So a lot of people are reporting that they have great data or they're very pleased with the results, but that's privately and it's off the record and I can't get anyone to go on the record.
I just recently at Princeton, the Center for Information Technology Policy ran a meeting about AI, and somebody, again in Chatham House, I can't say who it was, but an organization that's sort of between corporate and—anyway it's a special kind of organization, they said that they're going to try and do this and so I begged them to document it. I said look you're in a different situation you don't have ordinary customers, please document the results fully and then publish papers about it so we can really see what the outcomes are.
So I hope we'll have that data, but so far I could only tell you that people are saying it really is working.
One of the possible shortfalls of that kind of situation, well first of all being sure that you can eliminate bias that way, no; there's all kinds of ways you can accidentally pick up on things.
So even if you don't have gender you might recognize gender from the name, for example. So there's ways that machine learning picks up on regularities that are illegal and, again, you have to do your own auditing and make sure that that isn't happening.
And I guess that's the biggest concern. Of course anytime you scan something and make it digital the net makes it amenable to hacking, so you have to be careful about that.
And I guess the biggest thing is don't believe that just because you've automated part of a process you've made it fair. You have to keep checking—Just like anything else you keep going to improve.
But yeah when you put these things in front of you and when you write them down, then yeah you have the potential to keep improving.
I guess there's one other thing, which I haven't mentioned, which is that once you've automated the process you do open the door for somebody who is, say, an evil racist to go in and actually tweak things and make it so that you get all one race.
So you need to make sure that there's adequate oversight and regular auditing because people worry about accidentally introducing bias, and that's good, we should worry about that, but we should be really worried about deliberately introducing bias.
That's the thing that I think, again, because people think artificial intelligence is like space aliens that are kind of - it's actually almost like sort of the Greco Roman or Nordic gods or something, like “Maybe we can pray to them correctly and they'll give us what we want, but they're capricious and we're not sure.”
No, it's not like that. It really is something that we have an opportunity to try to fix it, and it works in systematic ways, but it's important to understand that people are writing it, and that means that some people will make mistakes, some people will be sloppy, some people will do what they seriously think is the best thing, but it actually isn't legal and some people will go out of their way to do bad things because they're just vandals or because that's how they got elected or whatever.
The best hiring manager might just be the computer sitting on your desk. AI and ethics expert Joanna Bryson posits that artificial intelligence can go through all the resumes in a stack and find what employers are missing. Most humans, on the other hand, will rely on biases — whether they are aware of them or not — to get them through the selection process. This is sadly why those with European-sounding names get more calls for interviews than others. AI, she says, can change that. Joanna is brought to you today by Amway. Amway believes that diversity and inclusion are essential to the growth and prosperity of today’s companies. When woven into every aspect of the talent life cycle, companies committed to diversity and inclusion are the best equipped to innovate, improve brand image and drive performance.
Scientists discover what our human ancestors were making inside the Wonderwerk Cave in South Africa 1.8 million years ago.
- Researchers find evidence of early tool-making and fire use inside the Wonderwerk Cave in Africa.
- The scientists date the human activity in the cave to 1.8 million years ago.
- The evidence is the earliest found yet and advances our understanding of human evolution.
One of the oldest activities carried out by humans has been identified in a cave in South Africa. A team of geologists and archaeologists found evidence that our ancestors were making fire and tools in the Wonderwerk Cave in the country's Kalahari Desert some 1.8 million years ago.
A new study published in the journal Quaternary Science Reviews from researchers at the Hebrew University of Jerusalem and the University of Toronto proposes that Wonderwerk — which means "miracle" in Afrikaans — contains the oldest evidence of human activity discovered.
"We can now say with confidence that our human ancestors were making simple Oldowan stone tools inside the Wonderwerk Cave 1.8 million years ago," shared the study's lead author Professor Ron Shaar from Hebrew University.
Oldowan stone tools are the earliest type of tools that date as far back as 2.6 million years ago. An Oldowan tool, which was useful for chopping, was made by chipping flakes off of one stone by hitting it with another stone.
An Oldowan stone toolCredit: Wikimedia / Public domain
Professor Shaar explained that Wonderwerk is different from other ancient sites where tool shards have been found because it is a cave and not in the open air, where sample origins are harder to pinpoint and contamination is possible.
Studying the cave, the researchers were able to pinpoint the time over one million years ago when a shift from Oldowan tools to the earliest handaxes could be observed. Investigating deeper in the cave, the scientists also established that a purposeful use of fire could be dated to one million years back.
This is significant because examples of early fire use usually come from sites in the open air, where there is the possibility that they resulted from wildfires. The remnants of ancient fires in a cave — including burned bones, ash, and tools — contain clear clues as to their purpose.
To precisely date their discovery, the researchers relied on paleomagnetism and burial dating to measure magnetic signals from the remains hidden within a sedimentary rock layer that was 2.5 meters thick. Prehistoric clay particles that settled on the cave floor exhibit magnetization and can show the direction of the ancient earth's magnetic field. Knowing the dates of magnetic field reversals allowed the scientists to narrow down the date range of the cave layers.
The Kalahari desert Wonderwerk CaveCredit: Michael Chazan / Hebrew University of Jerusalem
Professor Ari Matmon of Hebrew University used another dating method to solidify their conclusions, focusing on isotopes within quartz particles in the sand that "have a built-in geological clock that starts ticking when they enter a cave." He elaborated that in their lab, the scientists were "able to measure the concentrations of specific isotopes in those particles and deduce how much time had passed since those grains of sand entered the cave."
Finding the exact dates of human activity in the Wonderwerk Cave could lead to a better understanding of human evolution in Africa as well as the way of life of our early ancestors.
Ancient corridors below the French capital have served as its ossuary, playground, brewery, and perhaps soon, air conditioning.
- People have been digging up limestone and gypsum from below Paris since Roman times.
- They left behind a vast network of corridors and galleries, since reused for many purposes — most famously, the Catacombs.
- Soon, the ancient labyrinth may find a new lease of life, providing a sustainable form of air conditioning.
Ancient mining areas below Paris for limestone (red) and gypsum (green).Credit: Émile Gérards (1859–1920) / Public domain
"If you're brave enough to try, you might be able to catch a train from UnLondon to Parisn't, or No York, or Helsunki, or Lost Angeles, or Sans Francisco, or Hong Gone, or Romeless."
China Miéville's fantasy novel Un Lun Dun is set in an eerie mirror version of London. In it, he hints that other cities have similar doubles. On the list that he offhandedly rattles off, Paris stands out. Because the City of Light really does have a twisted sister. Below Paris Overground is Paris Underground, the City of Darkness.
Most people will have heard of the Catacombs of Paris: subterranean charnel houses for the bones of around six million dead Parisians. They are one of the French capital's most famous tourist attractions – and undoubtedly its grisliest.
But they constitute only a small fragment of what the locals themselves call les carrières de Paris ("the mines of Paris"), a collection of tunnels and galleries up to 300 km (185 miles) long, most of which are off-limits to the public, yet eagerly explored by so-called cataphiles.
The Grand Réseau Sud ("Great Southern Network") takes up around 200 km beneath the 5th, 6th, 14th, and 15th arrondissements (administrative districts), all south of the river Seine. Smaller networks run beneath the 12th, 13th, and 16th arrondissements. How did they get there?
Paris stone and plaster of Paris
It all starts with geology. Sediments left behind by ancient seas created large deposits of limestone in the south of the city, mostly south of the Seine; and gypsum in the north, particularly in the hills of Montmartre and Ménilmontant. Highly sought after as building materials, both have been mined since Roman times.
The limestone is also known as Lutetian limestone (Lutetia is the Latin name for ancient Paris) or simply "Paris stone." It has been used for many famous Paris landmarks, including the Louvre and the grand buildings erected during Georges-Eugène Haussmann's large-scale remodelling of the city in the mid-19th century. The stone's warm, yellowish color provides visual unity and a bright elegance to the city.
The fine-powdered gypsum of northern Paris, used for making quick-setting plaster, was so famed for its quality that "plaster of Paris" is still used as a term of distinction. However, as gypsum is very soluble in water, the underground cavities left by its extraction were extremely vulnerable to collapse.
Like living on top of a rotting tooth: subsidence starts far below the surface, but it can destroy your house.Credit : Delavanne Avocats
In previous centuries, a road would occasionally open up to swallow a chariot, or even a whole house would disappear down a sinkhole. In 1778, a catastrophic subsidence in Ménilmontant killed seven. That's why the Montmartre gypsum quarries were dynamited rather than just left as they were. The remaining gypsum caves were to be filled up with concrete.
The official body governing Paris down below is the Inspection Générale des Carrières (IGC), founded in the late 1770s by King Louis XVI. The IGC was tasked with mapping and, where needed, propping up the current and ancient (and sometimes forgotten) mining corridors and galleries hiding beneath Paris.
A delightful hiding place
Also around that time, the dead of Paris were getting in the way of the living. At the end of the 18th century, their final destination consisted of about 200 small cemeteries, scattered throughout the city — all bursting at the seams, so to speak. There was no room to bury the newly dead, and the previously departed were fouling up both the water and air around their respective churchyards.
Something radical had to happen. And it did. From 1785 until 1814, the smaller cemeteries were emptied of their bones, which were transported with full funerary pomp to their final resting place in the ancient limestone quarries at Tombe-Issoire. Three large and modern cemeteries were opened to receive the remains of subsequent generations of Parisians: Montparnasse, Père-Lachaise, and Passy.
The six million dead Parisians in the Catacombs, from all corners of the capital and across many centuries, together form the world's largest necropolis — their now anonymized skulls and bones methodically stacked, occasionally into whimsical patterns. The Catacombs are fashioned into a memorial to the brevity of life. The message above the entrance reads: Arrête! C'est ici l'empire de la Mort. ("Halt! This is the empire of Death.")
That has not stopped the Catacombs, accessible via a side door to a classicist building on the Avenue du Colonel Henri Rol-Tanguy, making just about every Top 20 list of things to see in Paris.
An underground economy
However, while the Catacombs certainly are the most famous part of the centuries-old network beneath Paris, and in non-pandemic times draw thousands of tourists each day, they constitute just 1.7 km (1 mile) of the 300-km (185-mile) tunneling total.
Subterranean Paris wasn't just used for mining and storing dead people. In the 17th century, Carthusian monks converted the ancient quarries under their monastery into distilleries for the green or yellow liqueur that still carries their name, chartreuse.
Because the mines generally keep a constant cool temperature of around 15° C (60° F), they were also ideal for brewing beer, as happened on a large scale from the end of the 17th century until well into the 20th century. Several caves were dug especially for establishing breweries, and not just because of the ambient temperature: going underground allowed brewers to remain close to their customers without having to pay a premium for real estate up top.
Overview of the Paris Catacombs.Credit: Inspection Générale des Carrières, 1857 / Public domain.
At the end of the 19th century, the underground breweries of the 14th arrondissement alone produced more than a million hectoliters (22 million gallons) per year. One of the most famous of Paris' underground breweries, Dumesnil, stayed in operation until the late 1960s.
In that decade, the network of corridors and galleries south of the Seine, long since abandoned by miners, became the unofficial playground for the young people of Paris. They explored the fantastical world beneath their feet, in some cases via entry points located in their very schools. Fascinated, these cataphiles ("catacomb lovers") read up on old books, explored the subterranean labyrinth, and drew up schematics that were passed around among fellow initiates as reverently as treasure maps.
As Robert Macfarlane writes in Underland, Paris-beneath-their-feet became "a place where people might slip into different identities, assume new ways of being and relating, become fluid and wild in ways that are constrained on the surface."
Some larger caves turned into notorious party zones: a 7-meter-tall gallery below the Val-de-Grâce hospital is widely known as "Salle Z." Over the last few decades, various other locations in subterranean Paris have hosted jazz and rock concerts and rave parties — like no other city, Paris really has an "underground music scene."
Hokusai's Great Wave as the backdrop to the "beach" under Paris.Credit: Reddit
Cataphiles vs. cataphobes
With popularity came increased reports of nuisance and crime — the tunnels provided easy access to telephone cables, which were stolen for the resale value of their copper.
The general public's "discovery" of the underground network led the city of Paris to officially interdict all access by non-authorized persons. That decree dates back to 1955, but the "underground police" have an understanding with seasoned cataphiles. Their main targets are so-called tourists, who by their lack of knowledge expose themselves to risk of injuries or worse, and degrade their surroundings, often leaving loads of litter in their wake.
The understanding does not extend to the IGC. Unlike in the 19th century, when weak cavities were shored up by purpose-built pillars, the policy now is to inject concrete to fill up endangered spaces — thus progressively blocking off parts of the network. That procedure has also been used to separate the Catacombs to prevent "infiltration" of the site by cataphiles.
Many subterranean streets have their own names, signs and all. This is the Rue des Bourguignons (Street of the Burgundians) below the Champs des Capucins (Capuchin Field), neither of which exists on the surface.Credit: Jean-François Gornet via Wikimedia and licensed under
The cataphiles, however, are fighting back. In a game of cat and mouse with the authorities, they are reopening blocked passages and creating chatières ("cat flaps") through which they can squeeze into chambers no longer accessible via other underground corridors.
Catacomb climate control
Alone against the unstoppable tide of concrete, the amateurs of Underground Paris would be helpless. But the fight against climate change may turn the subterranean labyrinths from a liability into an asset — and the City of Paris into an ally.
The UN's 2015 Climate Plan — concluded in Paris, by the way — requires the world to reduce greenhouse gas emissions by 75 percent by 2050. And Paris itself wants to be Europe's greenest city by 2030. More sustainable climate control of our living spaces would be a great help toward both targets. A lot of energy is spent heating houses in winter and cooling them in summer.
This is where the constant temperature of the Parisian tunnels comes in. It's not just good for brewing beer; it's a source of geothermal energy, says Fieldwork, an architectural firm based in Paris. It can be used to temper temperatures, helping to cool houses in summer and warming them in winter.
One catch for the cataphiles: it also works when the underground cavities are filled up with concrete. So perhaps one day, Paris Underground, fully filled up with concrete, will completely fall off the map, reducing the city's formerly real doppelgänger into an air conditioning unit.
Cool in summer, warm in winter: Paris Underground could become Paris A/C.Credit: Fieldwork
Strange Maps #1083
Got a strange map? Let me know at email@example.com.
Meconium contains a wealth of information.
- A new study finds that the contents of an infants' first stool, known as meconium, can predict if they'll develop allergies with a high degree of accuracy.
- A metabolically diverse meconium, which indicates the initial food source for the gut microbiota, is associated with fewer allergies.
- The research hints at possible early interventions to prevent or treat allergies just after birth.
The prevalence of allergies arising in childhood has increased over the last 50 years, with 30 percent of the human population now having some kind of atopic disease such as eczema, food allergies, or asthma. The cause of this increase is still subject to debate, though it has been associated with a number of factors, including changes to the gut microbiomes of infants.
A new study by Canadian researchers published in Cell Reports Medicine may shed further light on how these allergies develop in children by examining the contents of their first diaper.
The things you do for science
The research team examined the first stool of 100 infants from the CHILD Cohort Study. The first stool of an infant is a thick, green, horrid-looking substance called meconium. It consists of various things that the infant ingests during the second half of gestation. Additionally, it provides not only a snapshot of what the infant was exposed to during that time, but it also reveals what the food sources will be for the initial gut bacteria that colonize the baby's digestive tract.
The content of the meconium was examined and found to contain such varied elements as amino acids, lipids, carbohydrates, and myriad other substances.
A graph of the comparative, summed abundance of different elements in a metabolic pathway after scaling to median abundance of each metabolite. The blue figures are those children without atopy, the yellow ones show the data for those with an atopic condition. Petersen et al.
The authors fed this information into an algorithm that used this data, along with the identities of the bacteria present as well as the baby's overall health, to predict which infants would go on to develop allergies within one year. The algorithm got it right 76 percent of the time.
A way to prevent childhood allergies?
Infants whose meconium had a less diverse metabolic niche the initial microbes to settle in the gut were at the highest risk of developing allergies a year later. Many of these elements were associated with the presence or absence of different bacterial groups in the digestive system of the child, which play an increasingly appreciated role in our overall health and development. The findings were summarized by senior co-author Dr. Brett Finlay:
"Our analysis revealed that newborns who developed allergic sensitization by one year of age had significantly less 'rich' meconium at birth, compared to those who didn't develop allergic sensitization."
The findings could be used to help understand how allergies form and even how to prevent them. Co-author Dr. Stuart Turvey commented on this possibility:
"We know that children with allergies are at the highest risk of also developing asthma. Now we have an opportunity to identify at-risk infants who could benefit from early interventions before they even begin to show signs and symptoms of allergies or asthma later in life."
A model for early childhood allergies
Petersen et al.
As shown above, the authors constructed a model of how they believe metabolites and bacterial diversity help prevent allergies. Increased diversity of metabolic products in the meconium encourage the development of "healthy" families of bacteria, like Peptostreptococcaceae, which in turn promote the development of a healthy and diverse gut microbiome. Ultimately, such diversity decreases the likelihood that a child will develop allergies.