Using Wikipedia to Automatically Fact-Check the Internet

Some day fact-checking will be as easy as using spell-check.

Wikipedia is wonderful resource. I use it almost everyday for work and for pleasure — it's an easy way to find sources for articles or look up scientific terms. The truth is, in this fast-paced industry, traditional fact-checking cannot keep up with the volume and diversity of topics in which journalists and bloggers are expected to write. But even with editors to fact-check my work, it's easy for misinformation to run rampant online.


Wikipedia seems to be a large exception to this rule. Harvard University's Jonathan Zittrain thinks the site is a remarkable and unique model of a self-regulating entity. But what's most astounding about this community is its governors and stakeholders are both members of the public at large.

Still, the rest of the Internet is a dangerous source — ungoverned and unchecked. Though, Google is trying to fix that. It would be nice if checking facts were as easy as checking spelling in Word docs. Fortunately, computer scientists are on it.

Lead author of a study, Giovanni Luca Ciampaglia, said in a press release:

“We live in an age of information overload, including abundant misinformation, unsubstantiated rumors, and conspiracy theories whose volume threatens to overwhelm journalists and the public.”

So, researchers from Indiana University managed to devise a system that assigns "truth scores" to topics ranging from history to entertainment, all drawn from Wikipedia.

"Our experiments point to methods to abstract the vital and complex human task of fact-checking into a network-analysis problem, which is easy to solve computationally."

The researchers used the infoboxes on the site to create a "knowledge graph" that would create links between various concepts, such as "Socrates is a person" or "Paris is the capital of France."

Ciampaglia observed:

"The measurement of the truthfulness of statements appears to rely strongly on indirect connections, or 'paths,' between concepts. If we prevented our fact-checker from traversing multiple nodes on the graph, it performed poorly since it could not discover relevant indirect connections. But because it's free to explore beyond the information provided in one infobox, our method leverages the power of the full knowledge graph."

The group realizes Wikipedia is not 100 percent perfect, and plans on using other sources of knowledge to expand on the nodes their program can hit, with sources such as Freebase. However, they do believe it's important now more than ever that computational fact-checkers could help in solving some of the problems with misinformation when it comes to important issues, such as climate change and vaccines.

Wikipedia co-founder Jimmy Wales explains how a dedicated community of users keeps the site accurate and honest. Despite the potential for abuse in inherent in a publicly edited encyclopedia, Wales tries to avoid designing against the wrong that people might do.

The 4 types of thinking talents: Analytic, procedural, relational and innovative

Understanding thinking talents in yourself and others can build strong teams and help avoid burnout.

Big Think Edge
  • Learn to collaborate within a team and identify "thinking talent" surpluses – and shortages.
  • Angie McArthur teaches intelligent collaboration for Big Think Edge.
  • Subscribe to Big Think Edge before we launch on March 30 to get 20% off monthly and annual memberships.
Keep reading Show less

Tech billionaires could end climate change. So why aren’t they?

David Wallace-Wells points out that the people who can save the world just aren't all that interested.

Videos
  • Saving the world from the apocalyptic impact of climate change should be a dream for many Silicon Valley titans concerned about legacy, says David Wallace-Wells, and yet few are dedicating themselves to addressing the catastrophe.
  • Negative emissions technology funded by Bill Gates exists. It would cost $3 trillion per year to operate and would mean human industry could continue at current levels without global warming.
  • That figure sounds astronomical, however global subsidies to fossil fuel industries cost $5 trillion per year.
Keep reading Show less

Horseshoe crabs are drained for their blue blood. That practice will soon be over.

The blood of horseshoe crabs is harvested on a massive scale in order to retrieve a cell critical to medical research. However, recent innovations might make this practice obsolete.

Credit: Business Insider (video)
Surprising Science
  • Horseshoe crabs' blue blood is so valuable that a quart of it can be sold for $15,000.
  • This is because it contains a molecule that is crucial to the medical research community.
  • Today, however, new innovations have resulted in a synthetic substitute that may end the practice of farming horseshoe crabs for their blood.
Keep reading Show less

Jordan Peterson on Joe Rogan: The gender paradox and the importance of competition

The Canadian professor has been on the Joe Rogan Experience six times. There's a lot of material to discuss.

Personal Growth
  • Jordan Peterson has constantly been in the headlines for his ideas on gender over the last three years.
  • While on Joe Rogan's podcast, he explains his thoughts on the gender differences in society.
  • On another episode, Peterson discusses the development of character through competition.
Keep reading Show less