One of the paradoxes of information theory, as James Gleick points out in today's lesson, is this:
Information, such as a string of English text, has organization in it and the organization allows you to predict what the next bit in a given message is going to be.
However, because you can predict it, it’s not as surprising. And because it has less surprise, it carries less information. The idea of information as surprise is associated with disorder and randomness. As Gleick explains, this is a scary idea. As humans, we crave meaning. And so the idea that information might be meaningless is an extremely troubling one, given that we are living in the "age of information."