'Information Theory' Is Misinforming Us (Because The Meaning Isn’t In The Message).

Information Theory explicitly ignores meaning. Its focus on messages makes it uninformative about their effects. And limits the usefulness of its way of quantifying information. 

“Information theory” is misnamed. And information operates differently in physics versus biology.

1. Gregory Chaitin applies “information theory” to biology by casting DNA as “a universal programming language found in every cell.”

2. But information theory is misnamed — it covers only symbolically encoded messages, not information generally. It quantifies information by explicitly ignoring meaning. It can do this because usually the meaning of a message isn’t in the message. It’s in what the message refers to (or causes).

3. To a signaling engineer, the messages “set” and “ant” have equal amounts of information, three symbols each. Yet the Oxford English Dictionary needs 60,000 words to describe the meanings of “set” versus less than 60 for “ant.”  

4. Information theory’s engineering mindset presumes simple semantics — clean 1:1 mappings from message components to looked-up meaning — but evolved systems like language have more complex semantics — e.g., the 430 verb senses of “set.” Hence the amount of information in a message often doesn’t relate simply to its meaning (or the complexity of its effects).

5. Saying the human genome’s 3 billion base pairs contain ~770 MB of information isn’t the whole story. Much else (including other information) is needed for DNA’s messages to be effective. As Richard Lewontin notes, DNA isn’t “self-replicating”; it needs a vast molecular machinery and a very particular environment (context) to work (express its meanings).

6. Much quality is lost in quantifying loose types. Comparing genes numerically — as in “humans and chimps share ~99 percent of their DNA” — effectively ignores gene semantics. Texts with 99 percent of the same words can have very different meanings (word combinations matter more than word counts).

7. DNA’s “language of life” has even higher complexity. Its meanings (its sentences) aren’t all statically predefined — they’re built dynamically. After DNA completes its parental message transmission and developmental “recipe” roles, its genes enjoy an active social life. Their modular functions (protein-making “subroutines”) are orchestrated by environmental messages.

8. Despite some laxity, statements like, “Our bodies are full of software,” and, “All biological events are programmed,” highlight how processes in biology can handle information differently than those of physics.

9. Do objects in physics process information? A thrown ball’s path is somehow computed/followed, so at least metaphorically, that’s information processing. And in that sense, information and causality are related.

10. Physics never needs what programmers call exception handling. Its patterns don’t have exceptions. There’s a 1:1 directness to physics’ cause-effect structure. Or, where a cause has many effects, they have a stable, or predictable, distribution. So probability and statistics apply.

11. Biology’s information processing is more complex (more software-like, more algorithmic). Somewhere between its low-level biochemical cause-effect interactions and life’s higher-level decision processes, different kinds of logic emerge. In some contexts, cause and effect aren’t direct; they’re mediated by semantics (see Charles Darwin's “Hindoo,” on belief and biochemistry interacting).

Logic structures and information processing appear to vary by domain.


Befriend your ideological opposite. It’s fun.

Step inside the unlikely friendship of a former ACLU president and an ultra-conservative Supreme Court Justice.

Sponsored by Charles Koch Foundation
  • Former president of the ACLU Nadine Strossen and Supreme Court Justice Antonin Scalia were unlikely friends. They debated each other at events all over the world, and because of that developed a deep and rewarding friendship – despite their immense differences.
  • Scalia, a famous conservative, was invited to circles that were not his "home territory", such as the ACLU, to debate his views. Here, Strossen expresses her gratitude and respect for his commitment to the exchange of ideas.
  • "It's really sad that people seem to think that if you disagree with somebody on some issues you can't be mutually respectful, you can't enjoy each other's company, you can't learn from each other and grow in yourself," says Strossen.
  • The opinions expressed in this video do not necessarily reflect the views of the Charles Koch Foundation, which encourages the expression of diverse viewpoints within a culture of civil discourse and mutual respect.
Keep reading Show less

Physicists find new state of matter that can supercharge technology

Scientists make an important discovery for the future of computing.

Surprising Science
  • Researchers find a new state of matter called "topological superconductivity".
  • The state can lead to important advancements in quantum computing.
  • Utilizing special particles that emerge during this state can lead to error-free data storage and blazing calculation speed.
Keep reading Show less

Physicist advances a radical theory of gravity

Erik Verlinde has been compared to Einstein for completely rethinking the nature of gravity.

Photo by Willeke Duijvekam
Surprising Science
  • The Dutch physicist Erik Verlinde's hypothesis describes gravity as an "emergent" force not fundamental.
  • The scientist thinks his ideas describe the universe better than existing models, without resorting to "dark matter".
  • While some question his previous papers, Verlinde is reworking his ideas as a full-fledged theory.
Keep reading Show less

How to heal trauma with meaning: A case study in emotional evolution

As tempting as it may be to run away from emotionally-difficult situations, it's important we confront them head-on.

  • Impossible-sounding things are possible in hospitals — however, there are times when we hit dead ends. In these moments, it's important to not run away, but to confront what's happening head-on.
  • For a lot of us, one of the ways to give meaning to terrible moments is to see what you can learn from them.
  • Sometimes certain information can "flood" us in ways that aren't helpful, and it's important to figure out what types of data you are able to take in — process — at certain times.
Keep reading Show less