Twitter - Crystal Ball Into the Future?

What if you had a crystal ball that could predict the rise and fall of the stock market? Or that predicted which candidate would win the election and thus if your taxes would rise or fall? It’s hard to predict both the vagaries of financial markets and the winner of a tight election race. Hundreds of thousands of people determine the result in both case, and statisticians try to measure the direction by taking sample polls. Now analysts have a far better tool, a crystal ball really, to predict how masses of humanity will behave within the near future. It’s called Twitter.

People like to express their emotions on Twitter, and decisions that are made by large numbers of people are more often driven by emotions than deep analysis. Emotions by nature are often irrational making them difficult to predict. But people’s tweets expose the temperature of their emotions, allowing analysts to make an assessment on the trend in aggregate. This is exactly what researchers Johan Bollen and Huina Mao at the Indiana University-Bloomington did to predict movements in the Dow Jones Industrial Average (DJIA). They discovered that when people’s emotions were calm (as identified by a set of words that express calmness), the stock market remained fairly stable for the next week. The power of their predictive algorithm trained on 9.8 tweets by 2.7 million people from February and December 2009: a staggering 87.7% in accurately describing the state of the DJIA for the next six days. Suffice it to say that since Bollen and Mao announced this result last week many hedge funds and banks are running to create algorithms that will mine Twitter data.

Twitter has been getting a great deal of attention lately in its ability to chart trends, including an HP study that predicted which movies would be blockbusters by analyzing tweets. The study’s algorithm was able to predict the opening weekend box-office performance of 24 films with 97% accuracy. Another study conducted by Tweetminister predicted which candidates in the UK elections would win their seats based on how many times the candidate was mentioned on Twitter. They showed that national predictions based on their twitter algorithm were 90.5% accurate.

The potential for mining Twitter data is unlimited: books, videos, music, to name just a few. Their marketers will all be interested in the crystal ball of Twitter to predict irrational human emotions.

Ayesha and Parag Khanna explore human-technology co-evolution and its implications for society, business and politics at The Hybrid Reality Institute.

LinkedIn meets Tinder in this mindful networking app

Swipe right to make the connections that could change your career.

Getty Images
Swipe right. Match. Meet over coffee or set up a call.

No, we aren't talking about Tinder. Introducing Shapr, a free app that helps people with synergistic professional goals and skill sets easily meet and collaborate.

Keep reading Show less

Space toilets: How astronauts boldly go where few have gone before

A NASA astronomer explains how astronauts dispose of their, uh, dark matter.

  • When nature calls in micro-gravity, astronauts must answer. Space agencies have developed suction-based toilets – with a camera built in to ensure all the waste is contained before "flushing".
  • Yes, there have been floaters in space. The early days of space exploration were a learning curve!
  • Amazingly, you don't need gravity to digest food. Peristalsis, the process by which your throat and intestines squeeze themselves, actually moves food and water through your digestive system without gravity at all.
Keep reading Show less

A world map of Virgin Mary apparitions

She met mere mortals with and without the Vatican's approval.

Strange Maps
  • For centuries, the Virgin Mary has appeared to the faithful, requesting devotion and promising comfort.
  • These maps show the geography of Marian apparitions – the handful approved by the Vatican, and many others.
  • Historically, Europe is where most apparitions have been reported, but the U.S. is pretty fertile ground too.
Keep reading Show less

Can the keto diet help treat depression? Here’s what the science says so far

A growing body of research shows promising signs that the keto diet might be able to improve mental health.

Photo: Public Domain
Mind & Brain
  • The keto diet is known to be an effective tool for weight loss, however its effects on mental health remain largely unclear.
  • Recent studies suggests that the keto diet might be an effective tool for treating depression, and clearing up so-called "brain fog," though scientists caution more research is necessary before it can be recommended as a treatment.
  • Any experiments with the keto diet are best done in conjunction with a doctor, considering some people face problems when transitioning to the low-carb diet.
Keep reading Show less