Self-Motivation
David Goggins
Former Navy Seal
Career Development
Bryan Cranston
Actor
Critical Thinking
Liv Boeree
International Poker Champion
Emotional Intelligence
Amaryllis Fox
Former CIA Clandestine Operative
Management
Chris Hadfield
Retired Canadian Astronaut & Author
Learn
from the world's big
thinkers
Start Learning

Information is Surprise

A bit, the smallest unit of information, the fundamental particle of information theory, is a choice, yes or no, on or off. 

One of the things that I became fairly comfortable with early on was that I wasn’t going to be able to offer a single definition of information.  I was going to write a whole book about this thing and was going to title it The Information, and I was never going to say in a short, pithy way what information was because it’s taken me 500 pages to say it.  And in fairness, it takes the Oxford English Dictionary not quite as big a space but something like 8,000 words to define this simple word.  


Having said that, I don't mean to be flippant.  The core of my book, the starting point for the book, is a scientific definition of information that emerged with the birth of information theory from the work of Claude Shannon and it’s a very mathematical definition, and yet it’s possible to talk about it in a human way.  You can say that information is surprise.  We know that information is something that we have a unit of measure for.  We measure information in bits, and, of course, that wasn’t always true.  That also began with Claude Shannon.  

A bit, the smallest unit of information, the fundamental particle of information theory, is a choice, yes or no, on or off.  It’s a choice that you can embody in electrical circuits and it is thanks to that that we have all this ubiquitous computing.  But it’s also the flip of a coin or it’s the lighting of one or two lanterns in the Old North Church when Paul Revere had to convey a single bit of information by land or by sea, a choice.  And again, it’s information because it’s surprise.  If you already know the answer, there's no information there. 

In Their Own Words is recorded in Big Think's studio.

Image courtesy of Shutterstock

Live on Tuesday | Personal finance in the COVID-19 era

Sallie Krawcheck and Bob Kulhan will be talking money, jobs, and how the pandemic will disproportionally affect women's finances.

3 "symptoms" of atheism, as described by a Christian minister

Do you get worried or angry? Ever forget to tithe? One minister has bad news for you.

Painting by John Bridges via Wikimedia Commons
Culture & Religion
  • A recently published article claims to identify the symptoms of "low-level atheism."
  • Among these symptoms are worrying, cursing, and not tithing.
  • There is a solution to all of this though, not being an atheist. Sending in money is also involved.
Keep reading Show less

Why is everyone so selfish? Science explains

The coronavirus pandemic has brought out the perception of selfishness among many.

Credit: Adobe Stock, Olivier Le Moal.
Personal Growth
  • Selfish behavior has been analyzed by philosophers and psychologists for centuries.
  • New research shows people may be wired for altruistic behavior and get more benefits from it.
  • Crisis times tend to increase self-centered acts.
Keep reading Show less

How Hemingway felt about fatherhood

Parenting could be a distraction from what mattered most to him: his writing.

Ernest Hemingway Holding His Son 1927 (Wikimedia Commons)
Culture & Religion

Ernest Hemingway was affectionately called “Papa," but what kind of dad was he?

Keep reading Show less
Videos

The biology of aliens: How much do we know?

Hollywood has created an idea of aliens that doesn't match the science.

Scroll down to load more…
Quantcast