Do Data Miners Know You Better than You Do?

A few simple concepts power today's powerful data mining algorithms, allowing companies and governments to gather data about who you are, what you do and what you might do. 

What's the Latest Development?


It's nearly tax time, and if your return looks anomalous with respect to the millions of others filed, the IRS might take a closer look. That's just one of the ways in which powerful computer algorithms can extract personal data over a wide range of information to give companies and governments a clear vision of who you are—and what you might do in the future. Another technique, called association learning, is currently used by Amazon to predict what you might buy in the future based on what other people bought after buying the same product you purchased. 

What's the Big Idea?

A digital signature is created and stored each time an interaction occurs over the Internet, meaning that the things you say and buy online are part of a massive data bank open to analysis. Regression is a technique that compares a company's predictions about your behavior to how you have actually behaved, allowing them to modify how they make their predictions, in hopes of improving them. Facebook, for example, might use regression to design their site in a way that encourages more interaction, something they have presumably done with Timeline. Based on initial user response, we might ask if Facebook knows us better than we know ourselves?

Photo credit: shutterstock.com

​There are two kinds of failure – but only one is honorable

Malcolm Gladwell teaches "Get over yourself and get to work" for Big Think Edge.

Big Think Edge
  • Learn to recognize failure and know the big difference between panicking and choking.
  • At Big Think Edge, Malcolm Gladwell teaches how to check your inner critic and get clear on what failure is.
  • Subscribe to Big Think Edge before we launch on March 30 to get 20% off monthly and annual memberships.
Keep reading Show less

Why is 18 the age of adulthood if the brain can take 30 years to mature?

Neuroscience research suggests it might be time to rethink our ideas about when exactly a child becomes an adult.

Mind & Brain
  • Research suggests that most human brains take about 25 years to develop, though these rates can vary among men and women, and among individuals.
  • Although the human brain matures in size during adolescence, important developments within the prefrontal cortex and other regions still take pace well into one's 20s.
  • The findings raise complex ethical questions about the way our criminal justice systems punishes criminals in their late teens and early 20s.
Keep reading Show less

Believe in soulmates? You're more likely to 'ghost' romantic partners.

Does believing in true love make people act like jerks?

Thought Catalog via Unsplash
Sex & Relationships
  • Ghosting, or cutting off all contact suddenly with a romantic partner, is not nice.
  • Growth-oriented people (who think relationships are made, not born) do not appreciate it.
  • Destiny-oriented people (who believe in soulmates) are more likely to be okay with ghosting.
Keep reading Show less

Mini-brains attach to spinal cord and twitch muscles

A new method of growing mini-brains produces some startling results.

(Lancaster, et al)
Surprising Science
  • Researchers find a new and inexpensive way to keep organoids growing for a year.
  • Axons from the study's organoids attached themselves to embryonic mouse spinal cord cells.
  • The mini-brains took control of muscles connected to the spinal cords.
Keep reading Show less