This Twitter Algorithm Predicts Mental Illness Better Than Trained Professionals

supervised learning algorithm can predict clinical depression much earlier and more accurately than trained health professionals.


One of the more surprising, and upsetting, uses of social media has been suicides performed on Facebook Live. Though reasons for suicide are complex, the mere threat is often a cry for help, acceptance, or recognition. During the two years I worked as a patient monitor in an emergency room, I discovered most people that attempt to take their own lives desire a pair of ears to listen to their problems more than anything else.

 

It’s hard to gauge a person’s reality based on social media habits, however. Those who spout vitriolic rhetoric are often quite approachable and reserved in person. We can’t read inflections and temperament from words on a screen, or take into consideration that the person might just be having a bad day. 

That said, social media can be a powerful indicator of those at risk for suffering from mental health disorders, a new study published in Scientific Reports shows. A team led by Andrew Reece, in the Department of Psychology at Harvard, collected Twitter data from 204 individuals. Of those, 105 suffered from depression, with a control of 99 healthy subjects. The team then used a supervised learning algorithm to see if changes in language predicted clinical depression. 

The answer is yes. Depressed patients used more words like death, no, and never, while posting fewer positive words—like happy, beach, and photo—in the lead-up to their diagnosis. 

Figure 4. Depression word-shift graph revealing contributions to difference in Twitter happiness observed between depressed (5.98) and healthy (6.11) participants. In column 3, (−) indicates a relatively negative word, and (+) indicates a relatively positive word, both with respect to the average happiness of all healthy tweets. An up (down) arrow indicates that word was used more (less) by the depressed class. Words on the left (right) contribute to a decrease (increase) in happiness in the depressed class. [Credit: Andrew G. Reece et. al.]

A second group pf 174 Twitter users was also studied. Of these, 63 suffered from PTSD. Again, changes in language revealed that they were likely to be diagnosed. 

These results are not perfect. In both situations there was a preselected pool of Twitter users with a close ratio of healthy to unhealthy, which does not reflect society as a whole. Add to this fact that many depressed people or those suffering from PTSD do not use social media. It would be hard to acquire firm numbers based on these shortcomings.

That said, Reece and his team are borrowing this predictive model from similar early warning systems in place for hard-to-detect cancers, disease outbreaks, and regional dietary health issues. Diseases like addiction and suicidal ideation have already been studied through social media. While this trend of using public facing data to detect potential cognitive disorders is new, cries for help might be detected, and treated, much sooner. 

Reece and team believe they have found if not a silver bullet for predicting depression and PTSD, at least a shinier one than has so far been developed: 

Our findings strongly support the claim that computational methods can effectively screen Twitter data for indicators of depression and PTSD. Our method identified these mental health conditions earlier and more accurately than the performance of trained health professionals, and was more precise than previous computational approaches.

With the current rise in depression and anxiety, especially among teens, a particularly vulnerable group that has now fully grown up on social media, such predictive tools could prove to be a valuable source of therapy and recovery moving forward. 

"We hope that our research will eventually help improve mental health care, for example in preventive screening,” Stanford researcher Katharina Lix told Digital Trends. “We could imagine clinicians using this technology as a supporting tool during a patient’s initial assessment, provided that the patient has agreed to have their social media data used in this way. However, before we get to that point, the technology needs to be validated using a larger sample of people that’s representative of the general population. We want to emphasize that any real-world application of this technology must carefully take into account ethical and privacy concerns."

 

--

Derek is the author of Whole Motion: Training Your Brain and Body For Optimal Health. Based in Los Angeles, he is working on a new book about spiritual consumerism. Stay in touch on Facebook and Twitter.

South African city to seize private land without paying in 'test case'

"Expropriation without compensation" is meant to address the nation's stark inequalities in wealth and land ownership.

An informal settlement in Johannesburg (Photo: Matt-80)
Politics & Current Affairs
  • Since the end of apartheid, South Africa has seized private land from citizens but always compensated owners.
  • The new proposal is a more radical approach to correcting apartheid-era inequality.
  • However, South Africa's constitution still requires the government to compensate land owners, so it's unclear how the government's seizure of private property without pay would play out in courts.
Keep reading Show less

Relationship hack: Why class clowns make better partners

Want a happy, satisfying relationship? Psychologists say the best way is to learn to take a joke.

Photo by Tim Mossholder on Unsplash
Sex & Relationships
  • New research looks at how partners' attitudes toward humor affects the overall quality of a relationship.
  • Out of the three basic types of people, people who love to be laughed at made for better partners.
  • Fine-tuning your sense of humor might be the secret to a healthy, happy, and committed relationship.
Keep reading Show less

Number of American parents not vaccinating infants has quadrupled

A measles comeback is not the sort of return our children deserve.

MIAMI, FL - OCTOBER 04: An influenza vaccination is prepared for a patient at the CVS Pharmacy store's MinuteClinic on October 4, 2018 in Miami, Florida. CVS stores will provide flu vaccinations at their MinuteClinic as well as the pharmacy and according to the Centers for Disease Control and Prevention and the American Academy of Pediatrics between now and the end of October is the best time to get vaccinated as the flu season begins. (Photo by Joe Raedle/Getty Images)
Politics & Current Affairs
  • The percentage of children under 2 years old who haven't received any vaccinations has quadrupled in the last 17 years.
  • In 2016 in Europe there were 5,273 cases of measles. One year later that jumped to 21,315 cases.
  • Discredited doctor Andrew Wakefield's false study linking vaccines and autism still influences parents, two decades later.
Keep reading Show less

42 percent of new cancer patients lose their life savings

A new study delivers the dark financial reality of cancer.

Photo: Ken Treloar / Unsplash
Politics & Current Affairs
  • 62 percent of cancer patients report being in debt due to their treatment.
  • 55 percent accrue at least $10,000 in debt, while 3 percent file for bankruptcy.
  • Cancer costs exceed $80 billion in America each year.
Keep reading Show less

Steven Mnuchin withdraws from Saudi conference over missing journalist

Treasury Secretary Steven Mnuchin has cancelled an upcoming trip to an economic conference in Saudi Arabia amid the controversy involving missing journalist Jamal Khashoggi.

(Photo by Chip Somodevilla/Getty Images)
Politics & Current Affairs
  • Saudi Arabia's economic conference has been dubbed "Davos in the Desert".
  • Mnuchin joins a growing list of officials and industry executives who've dropped out of the event.
  • It's turning into a PR nightmare for the nation, particularly for Crown Prince Mohammed bin Salman.
Keep reading Show less
(Opener)
Technology & Innovation
  • A Larry Page-backed company has announced that its flying car will go on sale in 2019.
  • It's called the BlackFly.
  • Not quite the escape from traffic you had in mind, but it's a jaw-dropping start.
Keep reading Show less

Where the water wars of the future will be fought

A new report warns about the increasing likelihood of international conflicts over water.

Abd al-Ibrahim, whose home was destroyed during fighting, as he rests on his trip to supply water to his family at the house they are squatting in the northern Syrian city of Raqa. October 15, 2018. (Photo credit: DELIL SOULEIMAN/AFP/Getty Images)
Politics & Current Affairs
  • A study finds that serious conflicts over water are going to arise around the globe.
  • The 5 hotspots identified by the paper include areas of the Nile, Ganges-Brahmaputra, Indus, Tigris-Euphrates, and Colorado rivers.
  • It's still possible to change course if we are prepared to address the effects of climate change.
Keep reading Show less
A Star Is Born, Warner Bros Pictures
Surprising Science
  • It has to do with two parts of the brain, both of which are thicker in those with better smell and spacial recognition.
  • Your nose can detect about 1 trillion smells.
  • While your nose isn't a full GPS, it can help you pick out a general direction.
Keep reading Show less