This Twitter Algorithm Predicts Mental Illness Better Than Trained Professionals
A supervised learning algorithm can predict clinical depression much earlier and more accurately than trained health professionals.
One of the more surprising, and upsetting, uses of social media has been suicides performed on Facebook Live. Though reasons for suicide are complex, the mere threat is often a cry for help, acceptance, or recognition. During the two years I worked as a patient monitor in an emergency room, I discovered most people that attempt to take their own lives desire a pair of ears to listen to their problems more than anything else.
It’s hard to gauge a person’s reality based on social media habits, however. Those who spout vitriolic rhetoric are often quite approachable and reserved in person. We can’t read inflections and temperament from words on a screen, or take into consideration that the person might just be having a bad day.
That said, social media can be a powerful indicator of those at risk for suffering from mental health disorders, a new study published in Scientific Reports shows. A team led by Andrew Reece, in the Department of Psychology at Harvard, collected Twitter data from 204 individuals. Of those, 105 suffered from depression, with a control of 99 healthy subjects. The team then used a supervised learning algorithm to see if changes in language predicted clinical depression.
The answer is yes. Depressed patients used more words like death, no, and never, while posting fewer positive words—like happy, beach, and photo—in the lead-up to their diagnosis.
Figure 4. Depression word-shift graph revealing contributions to difference in Twitter happiness observed between depressed (5.98) and healthy (6.11) participants. In column 3, (−) indicates a relatively negative word, and (+) indicates a relatively positive word, both with respect to the average happiness of all healthy tweets. An up (down) arrow indicates that word was used more (less) by the depressed class. Words on the left (right) contribute to a decrease (increase) in happiness in the depressed class. [Credit: Andrew G. Reece et. al.]
A second group pf 174 Twitter users was also studied. Of these, 63 suffered from PTSD. Again, changes in language revealed that they were likely to be diagnosed.
These results are not perfect. In both situations there was a preselected pool of Twitter users with a close ratio of healthy to unhealthy, which does not reflect society as a whole. Add to this fact that many depressed people or those suffering from PTSD do not use social media. It would be hard to acquire firm numbers based on these shortcomings.
That said, Reece and his team are borrowing this predictive model from similar early warning systems in place for hard-to-detect cancers, disease outbreaks, and regional dietary health issues. Diseases like addiction and suicidal ideation have already been studied through social media. While this trend of using public facing data to detect potential cognitive disorders is new, cries for help might be detected, and treated, much sooner.
Reece and team believe they have found if not a silver bullet for predicting depression and PTSD, at least a shinier one than has so far been developed:
Our findings strongly support the claim that computational methods can effectively screen Twitter data for indicators of depression and PTSD. Our method identified these mental health conditions earlier and more accurately than the performance of trained health professionals, and was more precise than previous computational approaches.
With the current rise in depression and anxiety, especially among teens, a particularly vulnerable group that has now fully grown up on social media, such predictive tools could prove to be a valuable source of therapy and recovery moving forward.
"We hope that our research will eventually help improve mental health care, for example in preventive screening,” Stanford researcher Katharina Lix told Digital Trends. “We could imagine clinicians using this technology as a supporting tool during a patient’s initial assessment, provided that the patient has agreed to have their social media data used in this way. However, before we get to that point, the technology needs to be validated using a larger sample of people that’s representative of the general population. We want to emphasize that any real-world application of this technology must carefully take into account ethical and privacy concerns."
Derek is the author of Whole Motion: Training Your Brain and Body For Optimal Health. Based in Los Angeles, he is working on a new book about spiritual consumerism. Stay in touch on Facebook and Twitter.
"Expropriation without compensation" is meant to address the nation's stark inequalities in wealth and land ownership.
- Since the end of apartheid, South Africa has seized private land from citizens but always compensated owners.
- The new proposal is a more radical approach to correcting apartheid-era inequality.
- However, South Africa's constitution still requires the government to compensate land owners, so it's unclear how the government's seizure of private property without pay would play out in courts.
Want a happy, satisfying relationship? Psychologists say the best way is to learn to take a joke.
- New research looks at how partners' attitudes toward humor affects the overall quality of a relationship.
- Out of the three basic types of people, people who love to be laughed at made for better partners.
- Fine-tuning your sense of humor might be the secret to a healthy, happy, and committed relationship.
A measles comeback is not the sort of return our children deserve.
- The percentage of children under 2 years old who haven't received any vaccinations has quadrupled in the last 17 years.
- In 2016 in Europe there were 5,273 cases of measles. One year later that jumped to 21,315 cases.
- Discredited doctor Andrew Wakefield's false study linking vaccines and autism still influences parents, two decades later.
A new study delivers the dark financial reality of cancer.
- 62 percent of cancer patients report being in debt due to their treatment.
- 55 percent accrue at least $10,000 in debt, while 3 percent file for bankruptcy.
- Cancer costs exceed $80 billion in America each year.
Treasury Secretary Steven Mnuchin has cancelled an upcoming trip to an economic conference in Saudi Arabia amid the controversy involving missing journalist Jamal Khashoggi.
- Saudi Arabia's economic conference has been dubbed "Davos in the Desert".
- Mnuchin joins a growing list of officials and industry executives who've dropped out of the event.
- It's turning into a PR nightmare for the nation, particularly for Crown Prince Mohammed bin Salman.
Are we sure this isn't alien technology?
- A Larry Page-backed company has announced that its flying car will go on sale in 2019.
- It's called the BlackFly.
- Not quite the escape from traffic you had in mind, but it's a jaw-dropping start.
A new report warns about the increasing likelihood of international conflicts over water.
- A study finds that serious conflicts over water are going to arise around the globe.
- The 5 hotspots identified by the paper include areas of the Nile, Ganges-Brahmaputra, Indus, Tigris-Euphrates, and Colorado rivers.
- It's still possible to change course if we are prepared to address the effects of climate change.
Follow your nose all the way home.
- It has to do with two parts of the brain, both of which are thicker in those with better smell and spacial recognition.
- Your nose can detect about 1 trillion smells.
- While your nose isn't a full GPS, it can help you pick out a general direction.
SMARTER FASTER trademarks owned by The Big Think, Inc. All rights reserved.