This Simple Trick Will Help You Read People's Emotions More Accurately

It seems intuitive that the best way to interpret how others are feeling would be to both see and hear how they’re behaving. However, a new study suggests that’s dead wrong.


Want to really understand how other people are feeling? Close your eyes and listen.

That’s the takeaway of a new study published in American Psychologist that explored the empathic accuracy of various forms of communication. The results are some of the first to demonstrate that the primary way we convey emotions may be through the voice – not facial expressions or body language, as previously thought.

“Humans are actually remarkably good at using many of their senses for conveying emotions, but emotion research historically is focused almost exclusively on the facial expressions,” said Michael Kraus, a social psychologist at Yale University and author of the study, to The Guardian.

The paper detailed several experiments. In the first, researchers asked online participants to view videos showing a group of friends teasing each other about a nickname. Participants were presented the scene in one of three ways – audio only, audio and video, and video only – and were then asked to interpret what the friends were feeling by rating emotions like amusement, embarrassment, or happiness on a scale of 0 to 8. Surprisingly, those who only heard the interaction – but didn’t watch the video – were best able to interpret the emotions of the scene.


Another study involved undergraduate students gathering together in a room to discuss their favorite TV shows, movies, food and beverages. One group had the conversation in a lighted room, the other in a darkened room. Similar to the first experiment, people who were visually impaired in the darkened room more accurately interpreted the emotions of others.

Finally, the researchers took audio from the first experiment in which friends were teasing each other and had participants listen to one of two versions: the actual dialog from the friends, or a computerized voice reading the exact same words. Although you might expect to glean a similar amount of emotional information from the words alone, participants who interpreted the scene by listening to the digital voice fared far worse at interpreting emotions.

“The difference between emotional information in voice-only communication by a computer versus a human voice was the largest across all studies,” Kraus said to Yale Insights. “It’s really how you speak—not just what you say—that matters for conveying emotion.”

It seems intuitive that more information – both audio and visual – would better equip you to read the minds of other people, but the opposite seems true.


One explanation has to do with the limits of our cognitive power. When we’re taking in complex audio and visual input, it takes our brains more effort to process information. It’s similar to how a computer slows down when you have a bunch of different programs running simultaneously. Visual information is particularly costly to process, as Art Markman notes for Psychology Today:

Quite a bit of the brain is taken up with understanding what is going on in our sensory world. For example, if you clasp your hands behind your head, most of the area taken up by your hands reflects the amount of the brain that is devoted to making sense of the information coming in through your eyes.

These same brain regions are also responsible for recalling visual memory. And that could explain why people tend to shut their eyes when trying to recall details, or solve complex tasks in general. A 2011 paper published in the journal Memory & Cognition illustrates this idea quite nicely.

For the study, participants were instructed to watch a bit of a TV show, and later were asked to recall details about what occurred in the episode. The researchers separated participants into four groups, asking each to recall the show while they either: stared at a blank computer screen, closed their eyes, watched a computer screen as it randomly displayed nonsense images, or stared at a blank computer screen while they heard spoken words in a strange language.

Like the recent study, the groups that had received the least visual information – that is, they closed their eyes or stared at a blank computer screen – performed best. Interestingly, the group that stared at the screen displaying weird images fared worst at recalling visual details, while the group that heard random bits of a strange language did worst at recalling audio details from the show.

The other possible explanation has darker implications. People have a natural tendency to disguise their emotions, whether they’re doing something as benign as forcing a smile when you’re feeling down at work or something as malicious trying to manipulate someone into a shady business deal. Because our voices seem to be the primary way we communicate our emotions, the addition of visual cues like body language and facial expressions adds a whole toolset people can use to disguise their true emotions – a deliberately thoughtful tilt of the head, a raise of the eyebrows, or any of those body language hacks written up in countless articles ever since that one TED talk.

Either way, the researchers suggest people pay more attention to what others are saying and how they’re saying it.

“There’s an opportunity here to boost your listening skills to work more effectively across cultures and demographic characteristics,” Kraus said. “Understanding other people’s intentions is foundational to success in the global and diverse business environment that characterizes both the present and the future.”

3D printing might save your life one day. It's transforming medicine and health care.

What can 3D printing do for medicine? The "sky is the limit," says Northwell Health researcher Dr. Todd Goldstein.

Northwell Health
Sponsored by Northwell Health
  • Medical professionals are currently using 3D printers to create prosthetics and patient-specific organ models that doctors can use to prepare for surgery.
  • Eventually, scientists hope to print patient-specific organs that can be transplanted safely into the human body.
  • Northwell Health, New York State's largest health care provider, is pioneering 3D printing in medicine in three key ways.
Keep reading Show less

Why Elon Musk doesn't like Jeff Bezos's space colonies

Elon Musk took issue with recent ideas for space exploration from Jeff Bezos.

Getty Images
Technology & Innovation
  • Elon Musk and Jeff Bezos have sparred over space exploration previously.
  • Musk wants to focus on Mars while Bezos has the moon and space colonies as goals.
  • In a recent tweet, Musk called out Bezos's plans for space colonies as unrealistic.
Keep reading Show less

10 new things we’ve learned about death

If you don't want to know anything about your death, consider this your spoiler warning.

Culture & Religion
  • For centuries cultures have personified death to give this terrifying mystery a familiar face.
  • Modern science has demystified death by divulging its biological processes, yet many questions remain.
  • Studying death is not meant to be a morbid reminder of a cruel fate, but a way to improve the lives of the living.
Keep reading Show less
Big Think Edge
  • Push Past Negative Self-Talk: Give Yourself the Proper Fuel to Attack the World, with David Goggins, Former NAVY SealIf you've ever spent 5 minutes trying to meditate, you know something most people don't realize: that our minds are filled, much of the time, with negative nonsense. Messaging from TV, from the news, from advertising, and from difficult daily interactions pulls us mentally in every direction, insisting that we focus on or worry about this or that. To start from a place of strength and stability, you need to quiet your mind and gain control. For former NAVY Seal David Goggins, this begins with recognizing all the negative self-messaging and committing to quieting the mind. It continues with replacing the negative thoughts with positive ones.