Twitter - Crystal Ball Into the Future?

What if you had a crystal ball that could predict the rise and fall of the stock market? Or that predicted which candidate would win the election and thus if your taxes would rise or fall? It’s hard to predict both the vagaries of financial markets and the winner of a tight election race. Hundreds of thousands of people determine the result in both case, and statisticians try to measure the direction by taking sample polls. Now analysts have a far better tool, a crystal ball really, to predict how masses of humanity will behave within the near future. It’s called Twitter.

People like to express their emotions on Twitter, and decisions that are made by large numbers of people are more often driven by emotions than deep analysis. Emotions by nature are often irrational making them difficult to predict. But people’s tweets expose the temperature of their emotions, allowing analysts to make an assessment on the trend in aggregate. This is exactly what researchers Johan Bollen and Huina Mao at the Indiana University-Bloomington did to predict movements in the Dow Jones Industrial Average (DJIA). They discovered that when people’s emotions were calm (as identified by a set of words that express calmness), the stock market remained fairly stable for the next week. The power of their predictive algorithm trained on 9.8 tweets by 2.7 million people from February and December 2009: a staggering 87.7% in accurately describing the state of the DJIA for the next six days. Suffice it to say that since Bollen and Mao announced this result last week many hedge funds and banks are running to create algorithms that will mine Twitter data.

Twitter has been getting a great deal of attention lately in its ability to chart trends, including an HP study that predicted which movies would be blockbusters by analyzing tweets. The study’s algorithm was able to predict the opening weekend box-office performance of 24 films with 97% accuracy. Another study conducted by Tweetminister predicted which candidates in the UK elections would win their seats based on how many times the candidate was mentioned on Twitter. They showed that national predictions based on their twitter algorithm were 90.5% accurate.

The potential for mining Twitter data is unlimited: books, videos, music, to name just a few. Their marketers will all be interested in the crystal ball of Twitter to predict irrational human emotions.

Ayesha and Parag Khanna explore human-technology co-evolution and its implications for society, business and politics at The Hybrid Reality Institute.

​There are two kinds of failure – but only one is honorable

Malcolm Gladwell teaches "Get over yourself and get to work" for Big Think Edge.

Big Think Edge
  • Learn to recognize failure and know the big difference between panicking and choking.
  • At Big Think Edge, Malcolm Gladwell teaches how to check your inner critic and get clear on what failure is.
  • Subscribe to Big Think Edge before we launch on March 30 to get 20% off monthly and annual memberships.
Keep reading Show less

Why are so many objects in space shaped like discs?

It's one of the most consistent patterns in the unviverse. What causes it?

  • Spinning discs are everywhere – just look at our solar system, the rings of Saturn, and all the spiral galaxies in the universe.
  • Spinning discs are the result of two things: The force of gravity and a phenomenon in physics called the conservation of angular momentum.
  • Gravity brings matter together; the closer the matter gets, the more it accelerates – much like an ice skater who spins faster and faster the closer their arms get to their body. Then, this spinning cloud collapses due to up and down and diagonal collisions that cancel each other out until the only motion they have in common is the spin – and voila: A flat disc.

This is the best (and simplest) world map of religions

Both panoramic and detailed, this infographic manages to show both the size and distribution of world religions.

(c) CLO / Carrie Osgood
Strange Maps
  • At a glance, this map shows both the size and distribution of world religions.
  • See how religions mix at both national and regional level.
  • There's one country in the Americas without a Christian majority – which?
Keep reading Show less
Photo by Alina Grubnyak on Unsplash
Mind & Brain

Do human beings have a magnetic sense? Biologists know other animals do. They think it helps creatures including bees, turtles and birds navigate through the world.

Keep reading Show less