Intellectual dark matter: What is it, and why is it meaningful?

Throughout history, we find knowledge that can't possibly be documented, but still it exists.

SAMO BURJA: Knowledge rests at the foundation of our society. Knowledge of how to build things like cars, airplanes, nuclear reactors, computers, but also knowledge how to build the companies and governments that allow for things such as cars, airplanes, and nuclear reactors. A failure of these social technologies ultimately results in a failure of the material technologies at hand. A lot of this knowledge, both the physical and the social knowledge is, however, not readily apparent and not easily describable in words. We live in a society that's dominated by bureaucracies. Bureaucracies that have evolved and where people follow rules and procedures that are written down. The vast universe of tacit knowledge, however, shows that there exists an intellectual dark matter all around us that we can't put into writing, can't put into words.

Intellectual dark matter is perhaps very similar to physical dark matter. Most of the mass in our universe is invisible, at least to telescopes, but we know it's there. We know it's there almost certainly because the galaxies are spinning too fast. The stars would fly apart were there not this 85 percent of invisible mass. Looking at society today if we only saw what was written down, what was explicitly laid out, what was explicitly documented on Wikipedia, for example. This could never hold together. This is why we know that intellectual dark matter is out there.

To understand intellectual dark matter you have to understand tacit knowledge and you have to understand technical debt. Technical debt is when someone else solves a very difficult problem be it in code or a manufacturing process or perhaps a philosophical puzzle. You're relying on their solution without even understanding their solution. You're taking these facts and already-built pieces as a given. And on top of them you build something else. It's, in fact, possible to lose this original knowledge. You then end up simply relying on this black box technology that's no longer around. A classical example of this is perhaps that to manufacture a Saturn V engine in say the Apollo rocket would today require a major reengineering effort by NASA.

The thousands of subcontractors that built the individual pieces of the engine even if the engine blueprints are around, those companies are no longer around, and the components would not be built to the same tolerance. So the technical debt that exists in an ecosystem of companies and other organizations and especially very skilled individuals can be very difficult to replicate, can be very difficult to document properly. The second type of knowledge is this knowledge that can't really be documented. How do you describe in words the exact right way to spin during a dance or the exact right way to, you know, throw a basketball into a hoop?

These things matter immensely. A world class surgeon is notably better than a mediocre surgeon for reasons that are almost impossible to put into words. A lot of our great scientific advances arrived out of us formalizing, using mathematics, the implicit and unstated understanding of how the physical world around us behaves. Say how an object falls to something that could be made visible, transparent. In a very real sense every step you might take in transforming the intellectual dark matter of our society into visible intellectual matter. Stuff that's written down that is formalized that is perhaps recorded in video is a step that reduces the fragility of our society.

  • You're probably familiar with the concept of physical dark matter, but what about intellectual dark matter?
  • In a similar way to the universe's dark-matter makeup, our vast body of knowledge contains a significant amount of information that can't easily be described in words.
  • If knowledge was passed down only through writings or direct experience, society would crumble.


‘Designer baby’ book trilogy explores the moral dilemmas humans may soon create

How would the ability to genetically customize children change society? Sci-fi author Eugene Clark explores the future on our horizon in Volume I of the "Genetic Pressure" series.

Surprising Science
  • A new sci-fi book series called "Genetic Pressure" explores the scientific and moral implications of a world with a burgeoning designer baby industry.
  • It's currently illegal to implant genetically edited human embryos in most nations, but designer babies may someday become widespread.
  • While gene-editing technology could help humans eliminate genetic diseases, some in the scientific community fear it may also usher in a new era of eugenics.
Keep reading Show less

Astrophysicists find unique "hot Jupiter" planet without clouds

A unique exoplanet without clouds or haze was found by astrophysicists from Harvard and Smithsonian.

Credit: M. Weiss/Center for Astrophysics | Harvard & Smithsonian
Surprising Science
  • Astronomers from Harvard and Smithsonian find a very rare "hot Jupiter" exoplanet without clouds or haze.
  • Such planets were formed differently from others and offer unique research opportunities.
  • Only one other such exoplanet was found previously.
Keep reading Show less

Lair of giant predator worms from 20 million years ago found

Scientists discover burrows of giant predator worms that lived on the seafloor 20 million years ago.

Credit: Rickard Zerpe / Flickr
Surprising Science
  • Scientists in Taiwan find the lair of giant predator worms that inhabited the seafloor 20 million years ago.
  • The worm is possibly related to the modern bobbit worm (Eunice aphroditois).
  • The creatures can reach several meters in length and famously ambush their pray.
Keep reading Show less

The mystery of the Bermuda Triangle may finally be solved

Meteorologists propose a stunning new explanation for the mysterious events in the Bermuda Triangle.

Surprising Science

One of life's great mysteries, the Bermuda Triangle might have finally found an explanation. This strange region, that lies in the North Atlantic Ocean between Bermuda, Miami and San Juan, Puerto Rico, has been the presumed cause of dozens and dozens of mind-boggling disappearances of ships and planes.

Keep reading Show less

FOSTA-SESTA: Have controversial sex trafficking acts done more harm than good?

The idea behind the law was simple: make it more difficult for online sex traffickers to find victims.

Credit: troyanphoto on Adobe Stock
Politics & Current Affairs
  • SESTA (Stop Enabling Sex Traffickers Act) and FOSTA (Allow States and Victims to Fight Online Sex Trafficking Act) started as two separate bills that were both created with a singular goal: curb online sex trafficking. They were signed into law by former President Trump in 2018.
  • The implementation of this law in America has left an international impact, as websites attempt to protect themselves from liability by closing down the sections of their sites that sex workers use to arrange safe meetings with clientele.
  • While supporters of this bill have framed FOSTA-SESTA as a vital tool that could prevent sex trafficking and allow sex trafficking survivors to sue those websites for facilitating their victimization, many other people are strictly against the bill and hope it will be reversed.
Keep reading Show less
Quantcast