This Twitter algorithm predicts mental illness better than trained professionals

supervised learning algorithm can predict clinical depression much earlier and more accurately than trained health professionals.


One of the more surprising, and upsetting, uses of social media has been suicides performed on Facebook Live. Though reasons for suicide are complex, the mere threat is often a cry for help, acceptance, or recognition. During the two years I worked as a patient monitor in an emergency room, I discovered most people that attempt to take their own lives desire a pair of ears to listen to their problems more than anything else.

It's hard to gauge a person's reality based on social media habits, however. Those who spout vitriolic rhetoric are often quite approachable and reserved in person. We can't read inflections and temperament from words on a screen, or take into consideration that the person might just be having a bad day.

That said, social media can be a powerful indicator of those at risk for suffering from mental health disorders, a new study published in Scientific Reports suggests. A team led by Andrew Reece, in the Department of Psychology at Harvard, collected Twitter data from 204 individuals. Of those, 105 suffered from depression, with a control of 99 healthy subjects. The team then used a supervised learning algorithm to see if changes in language predicted clinical depression.

The answer is yes. Depressed patients used more words like death, no, and never, while posting fewer positive words—like happy, beach, and photo—in the lead-up to their diagnosis.

Figure 4. Depression word-shift graph revealing contributions to difference in Twitter happiness observed between depressed (5.98) and healthy (6.11) participants. In column 3, (−) indicates a relatively negative word, and (+) indicates a relatively positive word, both with respect to the average happiness of all healthy tweets. An up (down) arrow indicates that word was used more (less) by the depressed class. Words on the left (right) contribute to a decrease (increase) in happiness in the depressed class. [Credit: Andrew G. Reece et. al.]

A second group pf 174 Twitter users was also studied. Of these, 63 suffered from PTSD. Again, changes in language revealed that they were likely to be diagnosed.

These results are not perfect. In both situations there was a preselected pool of Twitter users with a close ratio of healthy to unhealthy, which does not reflect society as a whole. Add to this fact that many depressed people or those suffering from PTSD do not use social media. It would be hard to acquire firm numbers based on these shortcomings.

That said, Reece and his team are borrowing this predictive model from similar early warning systems in place for hard-to-detect cancers, disease outbreaks, and regional dietary health issues. Diseases like addiction and suicidal ideation have already been studied through social media. While this trend of using public facing data to detect potential cognitive disorders is new, cries for help might be detected, and treated, much sooner.

Reece and team believe they have found if not a silver bullet for predicting depression and PTSD, at least a shinier one than has so far been developed:

Our findings strongly support the claim that computational methods can effectively screen Twitter data for indicators of depression and PTSD. Our method identified these mental health conditions earlier and more accurately than the performance of trained health professionals, and was more precise than previous computational approaches.

With the current rise in depression and anxiety, especially among teens, a particularly vulnerable group that has now fully grown up on social media, such predictive tools could prove to be a valuable source of therapy and recovery moving forward.

"We hope that our research will eventually help improve mental health care, for example in preventive screening," Stanford researcher Katharina Lix told Digital Trends. “We could imagine clinicians using this technology as a supporting tool during a patient's initial assessment, provided that the patient has agreed to have their social media data used in this way. However, before we get to that point, the technology needs to be validated using a larger sample of people that's representative of the general population. We want to emphasize that any real-world application of this technology must carefully take into account ethical and privacy concerns."

--

Derek is the author of Whole Motion: Training Your Brain and Body For Optimal Health. Based in Los Angeles, he is working on a new book about spiritual consumerism. Stay in touch on Facebook and Twitter.

3D printing might save your life one day. It's transforming medicine and health care.

What can 3D printing do for medicine? The "sky is the limit," says Northwell Health researcher Dr. Todd Goldstein.

Northwell Health
Sponsored by Northwell Health
  • Medical professionals are currently using 3D printers to create prosthetics and patient-specific organ models that doctors can use to prepare for surgery.
  • Eventually, scientists hope to print patient-specific organs that can be transplanted safely into the human body.
  • Northwell Health, New York State's largest health care provider, is pioneering 3D printing in medicine in three key ways.
Keep reading Show less

The information arms race can’t be won, but we have to keep fighting

The tactics that work now won't work for long.

Politics & Current Affairs

Arms races happen when two sides of a conflict escalate in a series of ever-changing moves intended to outwit the opponent.

Keep reading Show less

10 excerpts from Marcus Aurelius' 'Meditations' to unlock your inner Stoic

Great ideas in philosophy often come in dense packages. Then there is where the work of Marcus Aurelius.

(Getty Images)
Personal Growth
  • Meditations is a collection of the philosophical ideas of the Roman Emperor Marcus Aurelius.
  • Written as a series of notes to himself, the book is much more readable than the dry philosophy most people are used to.
  • The advice he gave to himself 2,000 years ago is increasingly applicable in our hectic, stressed-out lives.
Keep reading Show less

What if all humanity had to do to save itself was listen?

By working together, and learning from one another, we can build better systems.

Videos
  • Many of the things that we experience, are our imagination manifesting into this physical realm, avers artist Dustin Yellin.
  • People need to completely rethink the way they work together, and learn from one another, that they they can build better systems. If not, things may get "really dark" soon.
  • The first step to enabling cooperation is figuring out where the common ground is. Through this method, despite contrary beliefs, we may be able to find some degree of peace.