You have doppelgängers. They’re quietly influencing your life.

Companies refer to like-minded strangers when recommending products to you.

SETH STEPHENS-DAVIDOWITZ: So there's a methodology called k-Nearest Neighbor in big data analysis where you can find a person who looks similar to another person. Who's the most similar on a number of traits?

But I kind of renamed the search a doppelganger search because I think that's a cooler name for it and also accurate. So you basically look in a huge data set, you take a person and say "Who is the person who looks most similar to that person?" So one way you might use this is if Amazon's looking for what books to recommend. They may find your book-reading doppelganger. So across the whole universe of Amazon customers, who's the person who tends to buy books like you have bought? And then what books has that person recently read and enjoyed that you haven't read and enjoyed? And that's sort of how they recommend books to you. And this can be used in a lot of other areas. People are just starting to use this in health where you can say, across the entire universe of patients who has symptoms very similar to your symptoms, and what has worked for those people, are your health doppelgangers. So it's a very powerful methodology and it gets more powerful the more data you have. Because the more data you have the more similar, the more likely you're going to find someone in that data set who's really, really similar to you.

Some of this stuff, some of the big data analysis are things we have always kind of done. That's kind of what doctors try to do. They try to say, "Who are you similar to? Of all the patients I've seen, which ones remind me of your case, and what worked for them?" But they've been doing this on a small number of patients, namely the ones they've seen. Whereas the potential for big data is you can do it over the entire universe of patients and get people who are, really, much, much more similar to you. Really zoom in on the tiny subset of people who have a very similar path to you. Instead of saying "You have the condition depression" which might remind a doctor of a hundred depressed patients that he's seen over the past couple of years, you can say maybe that "You have a particular type of depression." So you maybe sleep all the time whereas other depressed patients don't sleep all the time, and you feel guilty whereas other depressed patients don't feel guilty, and then really find these people who are really, really similar who's depression has taken a much more similar path to yours than have other people's depressions.

  • One way companies recommend products to you is by referring the purchasing tendencies of individuals who have bought similar items in past. When these individuals have many similarities, they are referred to as doppelgangers.
  • This can also work in medicine. When someone gets sick, professionals may refer to the patient's health doppelganger, who's had similar symptoms, and prescribe treatments that previously worked.
  • It's a powerful methodology and it gets more powerful the more data you have. That is, the more data you have, the more likely you're going to find someone in that data set who's "really, really" similar to you.

Live on Monday: Does the US need one billion people?

What would happen if you tripled the US population? Join Matthew Yglesias and Charles Duhigg at 1pm ET on Monday, September 28.

Universe works like a cosmological neural network, argues new paper

Controversial physics theory says reality around us behaves like a computer neural network.

Credit: sakkmesterke
Surprising Science
  • Physicist proposes that the universe behaves like an artificial neural network.
  • The scientist's new paper seeks to reconcile classical physics and quantum mechanics.
  • The theory claims that natural selection produces both atoms and "observers".
Keep reading Show less

Learn innovation with 3-star Michelin chef Dominique Crenn

Dominique Crenn, the only female chef in America with three Michelin stars, joins Big Think Live.

Big Think LIVE

Having been exposed to mavericks in the French culinary world at a young age, three-star Michelin chef Dominique Crenn made it her mission to cook in a way that is not only delicious and elegant, but also expressive, memorable, and true to her experience.

Keep reading Show less

We studied what happens when guys add their cats to their dating app profiles

43% of people think they can get a sense of someone's personality by their picture.

Photo by Luigi Pozzoli on Unsplash
Sex & Relationships

If you've used a dating app, you'll know the importance of choosing good profile pics.

Keep reading Show less

‘Time is elastic’: Why time passes faster atop a mountain than at sea level

The idea of 'absolute time' is an illusion. Physics and subjective experience reveal why.

ESA
Surprising Science
  • Since Einstein posited his theory of general relativity, we've understood that gravity has the power to warp space and time.
  • This "time dilation" effect occurs even at small levels.
  • Outside of physics, we experience distortions in how we perceive time — sometimes to a startling extent.
Keep reading Show less

Quarantine rule breakers in 17th-century Italy partied all night – and some clergy condemned the feasting

17th-century outbreaks of plague in Italy reveal both tensions between religious and public health authorities.

Hulton Archive/Getty Images
Coronavirus

Since the beginning of the COVID-19 pandemic, conflicts between religious freedom and public health regulations have been playing out in courts around the world.

Keep reading Show less
Quantcast