Your Brain Is Vulnerable to Hacking. Companies Are Exploiting That.
We can't seem to resist frequent rewards, which is why slot machines and social media are both so addictive. What's more, they're designed that way, purposefully, to keep you coming back.
Tristan Harris is a design thinker, philosopher and entrepreneur.
Called the “closest thing Silicon Valley has to a conscience,” by The Atlantic magazine, Tristan Harris was a Design Ethicist at Google and is now a leader in Time Well Spent, a movement to align technology with our humanity. Time Well Spent aims to heighten consumer awareness about how technology shapes our minds, empower consumers with better ways to use technology and change business incentives and design practices to align with humanity’s best interest.
Tristan is an avid researcher of what influences human behavior, beliefs and interpersonal dynamics, drawing on insights from sleight of hand magic and hypnosis to cults and behavioral economics. Currently he is developing a framework for ethical influence, especially as it relates to the moral responsibility of technology companies.
His work has been featured on PBS NewsHour, The Atlantic Magazine, ReCode, TED, 1843 Economist Magazine, Wired, NYTimes, Der Spiegel, NY Review of Books, Rue89 and more.
Previously, Tristan was CEO of Apture, which Google acquired in 2011. Apture enabled millions of users to get instant, on-the-fly explanations across a publisher network of a billion page views per month.
Tristan holds several patents from his work at Apple, Wikia, Apture and Google. He graduated from Stanford University with a degree in Computer Science, focused on Human Computer Interaction, while dabbling in behavioral economics, social psychology, behavior change and habit formation in Professor BJ Fogg’s Stanford Persuasive Technology lab. He was rated #16 in Inc Magazine’s Top 30 Entrepreneurs Under 30 in 2009.
You can read his most popular essay: How Technology Hijacks People’s Minds – from a Magician and Google’s Design Ethicist.
Tristan Harris: One thing we don't talk about is that—it's sort of hard to talk about this—our minds have these kinds of back doors.
There's kind of—if you're human and you wake up and you open your eyes there is a certain set of dimensions to your experience that can be manipulated.
When I was a kid I was a magician, and you learn all about these limits: that short-term memory is about this long and there's different reaction times, and if you ask people certain questions in certain ways you can control the answer. And this is just the structure of being human. To be human means that you are persuadable in every single moment.
I mean the thing about magic, as an example, it’s that magic works on everybody—sleight of hand, right?
It doesn't matter what language you speak, it doesn't matter how intelligent you are, it's not about what someone knows. It's about how your mind actually works.
So knowing this, it turns out that there's this whole playbook of persuasive techniques that actually I learned when I was at the Stanford Persuasive Technology Lab and that most people in Silicon Valley in the tech industry learned as ways of getting your attention.
So one example is: we are all vulnerable to social approval. We really care what other people think of us. So for example, when you upload a new profile photo of yourself on Facebook, that's a moment where our mind is very vulnerable to knowing, “what do other people think of my new profile photo?”
And so when we get new likes on our profile photo, Facebook—knowing this—could actually message me and say, “oh, you have new likes on your profile photo.” And it knows that we'll be vulnerable to that moment because we all really care about when we're tagged in a photo or when we have a new profile photo.
And the thing is that they control the dial, the technology companies control the dial for when and how long your profile photo shows up on other people's newsfeeds, so they can orchestrate it so that other people more often end up liking your profile photo over a delayed period of time, for example, so that you end up having to more frequently come back and see what the new likes are.
And the problem is that they don't do this because they're evil, they do it because, again, they're in this race for our attention.
And we should also ask: is that necessarily such a bad thing if they're orchestrating it so that other people like my photo? I mean that might feel good to me.
So we have to have a new conversation about, as these technology companies use these techniques, these vulnerabilities in our minds, when is that actually aligned and good for us? When is that ethical? When is that honest? When is that fair? And when is that dishonest and unfair? Because they're actually manipulating our minds in a way that doesn't add up to our spending our time well on the screen.
Well, so another vulnerability in our mind is something called a variable schedule reward, and that's like a slot machine in Las Vegas. It turns out that slot machines make more money in the United States than baseball, movies and theme parks combined.
People become addicted to slot machines, I think it's two to three times faster than any other kind of gambling in a casino. So it's insane. And why is that?
Because it's very simple: you just pull a lever, and sometimes you get a reward and sometimes you don't. And the more random it is and the more variable it is the more addictive it becomes.
And the thing is, that that turns our phone into a slot machine, because every time we check our phone we're playing the slot machine to see “what did I get?”
Every time that we check our email, we're playing the slot machine to see, “What did I get? Did I get invited to an interview at Big Think or did I just get another newsletter?”
Or if you're on a dating site like Tinder and when you're swiping, each swipe is: you're playing the slot machine to see “did I get a match?”, I'm playing the slot machine to see, “did I get a match?”
And the problem is that this dynamic, these variable schedule rewards or this slot machine mechanic, is so powerful that it's the best thing at addicting people and putting you in the zone.
One of the original designers of the Facebook newsfeed told me that the thing that made the newsfeed work at the very, very, very beginning back in 2006 was in part a hardware innovation.
And I looked at her and I said, "What do you mean?" And she said it was actually the scroll wheel on a mouse, because with the scroll wheel on a mouse your hand never had to leave its resting position—you just scroll to see the next thing. Because before that you had to click on the down button or move your mouse and drag the arrow down and scroll the page that way. When you don’t, you can take your two fingers on a track pad and do this, or you can just scroll on a scroll wheel—it just means your hand never has to leave its resting position, and it's more like a slot machine: you can just keep swiping and playing just like in Vegas where there's the button right there. They actually changed it. In fact, it used to be a lever, and now it's just a button in Vegas because they found it's easier just to get people to see if they get a match this way.
So, how much on our phones, when we use our technology, Instagram is like a slot machine? What's going to come next on the feeds? Snapchat is a slot machine, each time you see the red notifications and you don't know what's behind it you're playing the slot machine when you click on it to see “what did I get?”
And so it's sprinkled all throughout these products because it's a very compelling way of getting people's attention.
Casinos, magicians, and the makers of social media platforms all know something about you: your mind is very vulnerable to influence. Just as the magician relies on limitations in your short term memory or visual acuity to accomplish sleight of hand, online software engineers leverage the limits of your mind to make their product addictive. From the sonorous ping of mobile phones to Facebook's highly nuanced algorithm, product makers understand that frequent reward is what keeps you coming back. And just like slot machines, the easier those rewards are to access, the more frequently we'll want them.
Once a week.
Subscribe to our weekly newsletter.
The more you see them, the better you get at spotting the signs.
A new study says the reason cave paintings are in such remote caverns was the artists' search for transcendence.
Evolution doesn't clean up after itself very well.
- An evolutionary biologist got people swapping ideas about our lingering vestigia.
- Basically, this is the stuff that served some evolutionary purpose at some point, but now is kind of, well, extra.
- Here are the six traits that inaugurated the fun.
The plica semilunaris<img class="rm-lazyloadable-image rm-shortcode" type="lazy-image" data-runner-src="https://assets.rebelmouse.io/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8xOTA5NjgwMS9vcmlnaW4ucG5nIiwiZXhwaXJlc19hdCI6MTY3NDg5NTg1NX0.kdBYMvaEzvCiJjcLEPgnjII_KVtT9RMEwJFuXB68D8Q/img.png?width=980" id="59914" width="429" height="350" data-rm-shortcode-id="b11e4be64c5e1f58bf4417d8548bedc7" data-rm-shortcode-name="rebelmouse-image" />
The human eye in alarming detail. Image source: Henry Gray / Wikimedia commons<p>At the inner corner of our eyes, closest to the nasal ridge, is that little pink thing, which is probably what most of us call it, called the caruncula. Next to it is the plica semilunairs, and it's what's left of a third eyelid that used to — ready for this? — blink horizontally. It's supposed to have offered protection for our eyes, and some birds, reptiles, and fish have such a thing.</p>
Palmaris longus<img class="rm-lazyloadable-image rm-shortcode" type="lazy-image" data-runner-src="https://assets.rebelmouse.io/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8xOTA5NjgwNy9vcmlnaW4uanBnIiwiZXhwaXJlc19hdCI6MTYzMzQ1NjUwMn0.dVor41tO_NeLkGY9Tx46SwqhSVaA8HZQmQAp532xLxA/img.jpg?width=980" id="879be" width="1920" height="2560" data-rm-shortcode-id="4089a32ea9fbb1a0281db14332583ccd" data-rm-shortcode-name="rebelmouse-image" />
Palmaris longus muscle. Image source: Wikimedia commons<p> We don't have much need these days, at least most of us, to navigate from tree branch to tree branch. Still, about 86 percent of us still have the wrist muscle that used to help us do it. To see if you have it, place the back of you hand on a flat surface and touch your thumb to your pinkie. If you have a muscle that becomes visible in your wrist, that's the palmaris longus. If you don't, consider yourself more evolved (just joking).</p>
Darwin's tubercle<img class="rm-lazyloadable-image rm-shortcode" type="lazy-image" data-runner-src="https://assets.rebelmouse.io/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8xOTA5NjgxMi9vcmlnaW4uanBnIiwiZXhwaXJlc19hdCI6MTY0ODUyNjA1MX0.8RuU-OSRf92wQpaPPJtvFreOVvicEwn39_jnbegiUOk/img.jpg?width=980" id="687a0" width="819" height="1072" data-rm-shortcode-id="ff5edf0a698e0681d11efde1d7872958" data-rm-shortcode-name="rebelmouse-image" />
Darwin's tubercle. Image source: Wikimedia commons<p> Yes, maybe the shell of you ear does feel like a dried apricot. Maybe not. But there's a ridge in that swirly structure that's a muscle which allowed us, at one point, to move our ears in the direction of interesting sounds. These days, we just turn our heads, but there it is.</p>
Goosebumps<img class="rm-lazyloadable-image rm-shortcode" type="lazy-image" data-runner-src="https://assets.rebelmouse.io/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8xOTA5NzMxNC9vcmlnaW4uanBnIiwiZXhwaXJlc19hdCI6MTYyNzEyNTc2Nn0.aVMa5fsKgiabW5vkr7BOvm2pmNKbLJF_50bwvd4aRo4/img.jpg?width=980" id="d8420" width="1440" height="960" data-rm-shortcode-id="8827e55511c8c3aed8c36d21b6541dbd" data-rm-shortcode-name="rebelmouse-image" />
Goosebumps. Photo credit: Tyler Olson via Shutterstock<p>It's not entirely clear what purpose made goosebumps worth retaining evolutionarily, but there are two circumstances in which they appear: fear and cold. For fear, they may have been a way of making body hair stand up so we'd appear larger to predators, much the way a cat's tail puffs up — numerous creatures exaggerate their size when threatened. In the cold, they may have trapped additional heat for warmth.</p>
Tailbone<img class="rm-lazyloadable-image rm-shortcode" type="lazy-image" data-runner-src="https://assets.rebelmouse.io/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8xOTA5NzMxNi9vcmlnaW4uanBnIiwiZXhwaXJlc19hdCI6MTY3MzQwMjc3N30.nBGAfc_O9sgyK_lOUo_MHzP1vK-9kJpohLlj9ax1P8s/img.jpg?width=980" id="9a2f6" width="1440" height="1440" data-rm-shortcode-id="4fe28368d2ed6a91a4c928d4254cc02a" data-rm-shortcode-name="rebelmouse-image" />
Image source: Decade3d-anatomy online via Shutterstock<p>Way back, we had tails that probably helped us balance upright, and was useful moving through trees. We still have the stump of one when we're embryos, from 4–6 weeks, and then the body mostly dissolves it during Weeks 6–8. What's left is the coccyx.</p>
The palmar grasp reflex<img class="rm-lazyloadable-image rm-shortcode" type="lazy-image" data-runner-src="https://assets.rebelmouse.io/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8xOTA5NzMyMC9vcmlnaW4uanBnIiwiZXhwaXJlc19hdCI6MTYzNjY0MDY5NX0.OSwReKLmNZkbAS12-AvRaxgCM7zyukjQUaG4vmhxTtM/img.jpg?width=980" id="8804c" width="1440" height="960" data-rm-shortcode-id="67542ee1c5a85807b0a7e63399e44575" data-rm-shortcode-name="rebelmouse-image" />
Palmar reflex activated! Photo credit: Raul Luna on Flickr<p> You've probably seen how non-human primate babies grab onto their parents' hands to be carried around. We used to do this, too. So still, if you touch your finger to a baby's palm, or if you touch the sole of their foot, the palmar grasp reflex will cause the hand or foot to try and close around your finger.</p>
Other people's suggestions<p>Amir's followers dove right in, offering both cool and questionable additions to her list. </p>
Fangs?<blockquote class="twitter-tweet" data-conversation="none" data-lang="en"><p lang="en" dir="ltr">Lower mouth plate behind your teeth. Some have protruding bone under the skin which is a throw back to large fangs. Almost like an upsidedown Sabre Tooth.</p>— neil crud (@neilcrud66) <a href="https://twitter.com/neilcrud66/status/1085606005000601600?ref_src=twsrc%5Etfw">January 16, 2019</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script>
Hiccups<blockquote class="twitter-tweet" data-conversation="none" data-lang="en"><p lang="en" dir="ltr">Sure: <a href="https://t.co/DjMZB1XidG">https://t.co/DjMZB1XidG</a></p>— Stephen Roughley (@SteBobRoughley) <a href="https://twitter.com/SteBobRoughley/status/1085529239556968448?ref_src=twsrc%5Etfw">January 16, 2019</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script>
Hypnic jerk as you fall asleep<blockquote class="twitter-tweet" data-conversation="none" data-lang="en"><p lang="en" dir="ltr">What about when you “jump” just as you’re drifting off to sleep, I heard that was a reflex to prevent falling from heights.</p>— Bann face (@thebanns) <a href="https://twitter.com/thebanns/status/1085554171879788545?ref_src=twsrc%5Etfw">January 16, 2019</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script> <p> This thing, often called the "alpha jerk" as you drop into alpha sleep, is properly called the hypnic jerk,. It may actually be a carryover from our arboreal days. The <a href="https://www.livescience.com/39225-why-people-twitch-falling-asleep.html" target="_blank" data-vivaldi-spatnav-clickable="1">hypothesis</a> is that you suddenly jerk awake to avoid falling out of your tree.</p>
Nails screeching on a blackboard response?<blockquote class="twitter-tweet" data-conversation="none" data-lang="en"><p lang="en" dir="ltr">Everyone hate the sound of fingernails on a blackboard. It's _speculated_ that this is a vestigial wiring in our head, because the sound is similar to the shrill warning call of a chimp. <a href="https://t.co/ReyZBy6XNN">https://t.co/ReyZBy6XNN</a></p>— Pet Rock (@eclogiter) <a href="https://twitter.com/eclogiter/status/1085587006258888706?ref_src=twsrc%5Etfw">January 16, 2019</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script>
Ear hair<blockquote class="twitter-tweet" data-conversation="none" data-lang="en"><p lang="en" dir="ltr">Ok what is Hair in the ears for? I think cuz as we get older it filters out the BS.</p>— Sarah21 (@mimix3) <a href="https://twitter.com/mimix3/status/1085684393593561088?ref_src=twsrc%5Etfw">January 16, 2019</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script>
Nervous laughter<blockquote class="twitter-tweet" data-lang="en"><p lang="en" dir="ltr">You may be onto something. Tooth-bearing with the jaw clenched is generally recognized as a signal of submission or non-threatening in primates. Involuntary smiling or laughing in tense situations might have signaled that you weren’t a threat.</p>— Jager Tusk (@JagerTusk) <a href="https://twitter.com/JagerTusk/status/1085316201104912384?ref_src=twsrc%5Etfw">January 15, 2019</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script>
Um, yipes.<blockquote class="twitter-tweet" data-conversation="none" data-lang="en"><p lang="en" dir="ltr">Sometimes it feels like my big toe should be on the side of my foot, was that ever a thing?</p>— B033? K@($ (@whimbrel17) <a href="https://twitter.com/whimbrel17/status/1085559016011563009?ref_src=twsrc%5Etfw">January 16, 2019</a></blockquote> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script>
Are we enslaved by the finer things in life?
- The Roman writer, Tacitus, argued that the Roman Empire was built by enslaving conquered people who became accustomed to fine living and luxury.
- Technology today has become so essential to our daily lives that it seems impossible to break free of it. It's as much a cage as a luxury.
- Being dependent on a thing gives it power over you. To need something or someone is, for better or worse, to limit yourself.