Forget Big Data. What your business needs is Dynamic Data
Numbers really are sexy. They are what will power our world for the foreseeable future. They are available like never before, and we know now how to use them wisely.
Nikolaus Otto invented the basic design of the 4-stroke internal combustion engine – the power plant that today moves most of the vehicles on the world’s roads – back in 1862. The engines of Otto’s day were clattering, weak, and inefficient smoke bombs that drank in rivers of gasoline in return for trickles of power.
Big Data is in a similar position today. Data, we have learned, is a potent energy source for moving businesses, but we have only just figured out how to turn that energy into the work that will power sales. Our methods have been inefficient, sucking data in through a fire hose and giving back only modest insights.
We may have wrung all the efficiency we can get out of the internal combustion engine, but we have only begun to ramp up the efficacy of our data processing. Fortunately, the efficiency of our data engines is growing at the same moment as the supply of data is booming. This same happy confluence greeted Otto’s new motor, and the age of the automobile was upon us. Can the same happen for data? Of course.
Companies big and small have begun to see how data – usually data they already have – can help their businesses grow dramatically with only minimal investment. The supply of data they are sitting on is, like the oil fields of Texas, enormous and waiting to be tapped. What’s been missing is the need for the data and the means to use it.
The need stems from the increasing competitive pressures facing modern business. Many, if not most, of the physical revolutions in business have already taken place. Companies must settle for incremental improvements that move them just a step ahead, a lead that vanishes quickly. All the while, they pour investment into finding the next breakthrough idea. It’s a frustrating wait since paradigm shifting products or services are once in a decade events. Increased scrutiny and greater accountability pushes business leaders to search for any advantage they can find. Product or service innovation may not supply it, but data innovation almost certainly will.
The means comes from the burgeoning supply of data that we exhale with every move we make in the modern economy. As I show in my book, Sexy Little Numbers, one simple business trip from London back home produces a flood of data, most of it still ignored by business, which can deliver bottom line results – profit! – if only it were used efficiently. The means is also supplied by dramatically increased computing power, which can unearth countless hidden, profitable patterns that are opaque to human analysts.
Big Data – a smug storehouse of unanalyzed information – is giving way to Dynamic Data. Dynamic Data is what happens when we learn how to use data wisely. Here are the three developments heralding the coming of Dynamic Data:
1. Data sourcing: The biggest breakthroughs of the next few years will be in gaining access to different types of data. Many companies produce vast quantities of data as a by-product of what they do. It’s been dubbed “data exhaust.” Most of that data just sits on servers collecting dust, but it could be turned into immensely valuable information if only it were put in the hands of the right people. Here’s an example. A software company developed the accounting software used by 80% of the US car maintenance shops. But there’s a hidden gem in the program. The software throws off a database of millions of cars with their entire car maintenance history as a by product of the application’s cloud-based solution. Imagine the value of that data to an automaker like Ford or Toyota! Big Data believes that size matters most, but future competitive advantage may very well go to the companies gain access to the Dynamic Data their competitors don't have.
2. Analytics: Finding the right data is only the first step. All that data still needs to be analyzed, and, increasingly, it will be machines, not humans, that do it. In the past, we employed big teams of statisticians to crunch all the data. This limited the amount of data we could process and the depth of insight we could expect. Analytics talent is rare, and even the best of it can never match a computer at tasks like this. The massive, cheap processing power available to us enables us to use brute force computing to crank out the algorithms that give Dynamic Data its brains.
3. Application: This is the biggest challenge. And the biggest opportunity. Finding and analyzing data will invariably produce insights that lead to profit. Or they will if they are used properly. Far too many marketing decisions are made without taking into account the insights derived from data. Even when data-driven insights are available, companies often fail to take advantage of them. The insights that Dynamic Data produces must be made easily accessible to all decision makers and presented in a language they can understand. Dynamic Data, when done right, tailors its insights to the challenges business leaders face, and it does so in real time. But Dynamic Data, no matter how good, will have no effect if decision makers ignore it. They need to be educated on what data can do for their businesses.
Thought of this way, numbers really are sexy. They are what will power our world for the foreseeable future. They are available like never before, and we know now how to use them wisely. Once we develop the habit of using Dynamic Data to inform our business decisions, data will transform our landscape. The businesses that ignore Dynamic Data? Well, they might as well be selling buggy whips.
- The meaning of the word 'confidence' seems obvious. But it's not the same as self-esteem.
- Confidence isn't just a feeling on your inside. It comes from taking action in the world.
- Join Big Think Edge today and learn how to achieve more confidence when and where it really matters.
The team caught a glimpse of a process that takes 18,000,000,000,000,000,000,000 years.
- In Italy, a team of scientists is using a highly sophisticated detector to hunt for dark matter.
- The team observed an ultra-rare particle interaction that reveals the half-life of a xenon-124 atom to be 18 sextillion years.
- The half-life of a process is how long it takes for half of the radioactive nuclei present in a sample to decay.
The controversial herbicide is everywhere, apparently.
- U.S. PIRG tested 20 beers and wines, including organics, and found Roundup's active ingredient in almost all of them.
- A jury on August 2018 awarded a non-Hodgkin's lymphoma victim $289 million in Roundup damages.
- Bayer/Monsanto says Roundup is totally safe. Others disagree.
One victim can break our hearts. Remember the image of the young Syrian boy discovered dead on a beach in Turkey in 2015? Donations to relief agencies soared after that image went viral. However, we feel less compassion as the number of victims grows. Are we incapable of feeling compassion for large groups of people who suffer a tragedy, such as an earthquake or the recent Sri Lanka Easter bombings? Of course not, but the truth is we aren't as compassionate as we'd like to believe, because of a paradox of large numbers. Why is this?
Compassion is a product of our sociality as primates. In his book, The Expanding Circle: Ethics, Evolution, and Moral Progress, Peter Singer states, "Human beings are social animals. We were social before we were human." Mr. Singer goes on to say, "We can be sure that we restrained our behavior toward our fellows before we were rational human beings. Social life requires some degree of restraint. A social grouping cannot stay together if its members make frequent and unrestrained attacks on one another."
Attacks on ingroups can come from forces of nature as well. In this light, compassion is a form of expressed empathy to demonstrate camaraderie.
Yet even after hundreds of centuries of evolution, when tragedy strikes beyond our community, our compassion wanes as the number of displaced, injured, and dead mounts.
The drop-off in commiseration has been termed the collapse of compassion. The term has also been defined in The Oxford Handbook of Compassion Science: ". . . people tend to feel and act less compassionately for multiple suffering victims than for a single suffering victim."
That the drop-off happens has been widely documented, but at what point this phenomenon happens remains unclear. One paper, written by Paul Slovic and Daniel Västfjäll, sets out a simple formula, ". . . where the emotion or affective feeling is greatest at N =1 but begins to fade at N = 2 and collapses at some higher value of N that becomes simply 'a statistic.'"
The ambiguity of "some higher value" is curious. That value may relate to Dunbar's Number, a theory developed by British anthropologist, Robin Dunbar. His research centers on communal groups of primates that evolved to support and care for larger and larger groups as their brains (our brains) expanded in capacity. Dunbar's is the number of people with whom we can maintain a stable relationship — approximately 150.
Some back story
Professor Robin Dunbar of the University of Oxford has published considerable research on anthropology and evolutionary psychology. His work is informed by anthropology, sociology and psychology. Dunbar's Number is a cognitive boundary, one we are likely incapable of breaching. The number is based around two notions; that brain size in primates correlates with the size of the social groups they live among and that these groups in human primates are relative to communal numbers set deep in our evolutionary past. In simpler terms, 150 is about the maximum number of people with whom we can identify with, interact with, care about, and work to protect. Dunbar's Number falls along a logorithmic continuum, beginning with the smallest, most emotionally connected group of five, then expanding outward in multiples of three: 5, 15, 50, 150. The numbers in these concentric circles are affected by multiple variables, including the closeness and size of immediate and extended families, along with the greater cognitive capacity of some individuals to maintain stable relationships with larger than normal group sizes. In other words, folks with more cerebral candlepower can engage with larger groups. Those with lesser cognitive powers, smaller groups.
The number that triggers "compassion collapse" might be different for individuals, but I think it may begin to unravel along the continuum of Dunbar's relatable 150. We can commiserate with 5 to 15 to 150 people because upon those numbers, we can overlay names and faces of people we know: our families, friends and coworkers, the members of our clan. In addition, from an evolutionary perspective, that number is important. We needed to care if bands of our clan were being harmed by raids, disaster, or disease, because our survival depended on the group staying intact. Our brains developed the capacity to care for the entirety of the group but not beyond it. Beyond our ingroup was an outgroup that may have competed with us for food and safety and it served us no practical purpose to feel sad that something awful had happened to them, only to learn the lessons so as to apply them for our own survival, e.g., don't swim with hippos.
Imagine losing 10 family members in a house fire. Now instead, lose 10 neighbors, 10 from a nearby town, 10 from Belgium, 10 from Vietnam 10 years ago. One could almost feel the emotion ebbing as the sentence drew to a close.
There are two other important factors which contribute to the softening of our compassion: proximity and time. While enjoying lunch in Santa Fe, we can discuss the death toll in the French revolution with no emotional response but might be nauseated to discuss three children lost in a recent car crash around the corner. Conflict journalists attempt to bridge these geotemporal lapses but have long struggled to ignite compassion in their home audience for far-flung tragedies, Being a witness to carnage is an immense stressor, but the impact diminishes across the airwaves as the kilometers pile up.
A Dunbar Correlation
Where is the inflection point at which people become statistics? Can we find that number? In what way might that inflection point be influenced by the Dunbar 150?
"Yes, the Dunbar number seems relevant here," said Gad Saad, PhD., the evolutionary behavioral scientist from the John Molson School of Business at Concordia University, Montreal, in an email correspondence. Saad also recommended Singer's work.
I also went to the wellspring. I asked Professor Dunbar by email if he thought 150 was a reasonable inflection point for moving from compassion into statistics. He graciously responded, lightly edited for space.
Professor Dunbar's response:
"The short answer is that I have no idea, but what you suggest is perfect sense. . . . One-hundred and fifty is the inflection point between the individuals we can empathize with because we have personal relationships with them and those with whom we don't have personalized relationships. There is, however, also another inflection point at 1,500 (the typical size of tribes in hunter-gatherer societies) which defines the limit set by the number of faces we can put names to. After 1,500, they are all completely anonymous."
I asked Dunbar if he knows of or suspects a neurophysiological aspect to the point where we simply lose the capacity to manage our compassion:
"These limits are underpinned by the size of key bits of the brain (mainly the frontal lobes, but not wholly). There are a number of studies showing this, both across primate species and within humans."
In his literature, Professor Dunbar presents two reasons why his number stands at 150, despite the ubiquity of social networking: the first is time — investing our time in a relationship is limited by the number of hours we have available to us in a given week. The second is our brain capacity measured in primates by our brain volume.
Friendship, kinship and limitations
"We devote around 40 percent of our available social time to our 5 most intimate friends and relations," Dunbar has written, "(the subset of individuals on whom we rely the most) and the remaining 60 percent in progressively decreasing amounts to the other 145."
These brain functions are costly, in terms of time, energy and emotion. Dunbar states, "There is extensive evidence, for example, to suggest that network size has significant effects on health and well-being, including morbidity and mortality, recovery from illness, cognitive function, and even willingness to adopt healthy lifestyles." This suggests that we devote so much energy to our own network that caring about a larger number may be too demanding.
"These differences in functionality may well reflect the role of mentalizing competencies. The optimal group size for a task may depend on the extent to which the group members have to be able to empathize with the beliefs and intentions of other members so as to coordinate closely…" This neocortical-to-community model carries over to compassion for others, whether in or out of our social network. Time constrains all human activity, including time to feel.
As Dunbar writes in The Anatomy of Friendship, "Friendship is the single most important factor influencing our health, well-being, and happiness. Creating and maintaining friendships is, however, extremely costly, in terms of both the time that has to be invested and the cognitive mechanisms that underpin them. Nonetheless, personal social networks exhibit many constancies, notably in their size and their hierarchical structuring." Our mental capacity may be the primary reason we feel less empathy and compassion for larger groups; we simply don't have the cerebral apparatus to manage their plights. "Part of friendship is the act of mentalizing, or mentally envisioning the landscape of another's mind. Cognitively, this process is extraordinarily taxing, and as such, intimate conversations seem to be capped at about four people before they break down and form smaller conversational groups. If the conversation involves speculating about an absent person's mental state (e.g., gossiping), then the cap is three — which is also a number that Shakespeare's plays respect."
We cannot mentalize what is going on in the minds of people in our groups much beyond our inner circle, so it stands to reason we cannot do it for large groups separated from us by geotemporal lapses.
In a paper, C. Daryl Cameron and Keith B. Payne state, "Some researchers have suggested that [compassion collapse] happens because emotions are not triggered by aggregates. We provide evidence for an alternative account. People expect the needs of large groups to be potentially overwhelming, and, as a result, they engage in emotion regulation to prevent themselves from experiencing overwhelming levels of emotion. Because groups are more likely than individuals to elicit emotion regulation, people feel less for groups than for individuals."
This argument seems to imply that we have more control over diminishing compassion than not. To say, "people expect the needs of large groups to be potentially overwhelming" suggests we consciously consider what that caring could entail and back away from it, or that we become aware that we are reaching and an endpoint of compassion and begin to purposely shift the framing of the incident from one that is personal to one that is statistical. The authors offer an alternative hypothesis to the notion that emotions are not triggered by aggregates, by attempting to show that we regulate our emotional response as the number of victims becomes perceived to be overwhelming. However, in the real world, for example, large death tolls are not brought to us one victim at a time. We are told, about a devastating event, then react viscerally.
If we don't begin to express our emotions consciously, then the process must be subconscious, and that number could have evolved to where it is now innate.
Gray matter matters
One of Dunbar's most salient points is that brain capacity influences social networks. In his paper, The Social Brain, he writes: "Path analysis suggests that there is a specific causal relationship in which the volume of a key prefrontal cortex subregion (or subregions) determines an individual's mentalizing skills, and these skills in turn determine the size of his or her social network."
It's not only the size of the brain but in fact, mentalizing recruits different regions for ingroup empathy. The Stanford Center for Compassion and Altruism Research and Education published a study of the brain regions activated when showing empathy for strangers in which the authors stated, "Interestingly, in brain imaging studies of mentalizing, participants recruit more dorsal portions of the medial prefrontal cortex (dMPFC; BA 8/9) when mentalizing about strangers, whereas they recruit more ventral regions of the medial prefrontal cortex (BA 10), similar to the MPFC activation reported in the current study, when mentalizing about close others with whom participants experience self-other overlap."⁷
It's possible the region of the brain that activates to help an ingroup member evolved for good reason, survival of the group. Other regions may have begun to expand as those smaller tribal groups expanded into larger societies.
There is an eclectic list of reasons why compassion may collapse, irrespective of sheer numbers:
(1) Manner: How the news is presented affects viewer framing. In her book, European Foreign Conflict Reporting: A Comparative Analysis of Public News, Emma Heywood explores how tragedies and war are offered to the viewers, which can elicit greater or lesser compassionate responses. "Techniques, which could raise compassion amongst the viewers, and which prevail on New at Ten, are disregarded, allowing the victims to remain unfamiliar and dissociated from the viewer. This approach does not encourage viewers to engage with the sufferers, rather releases them from any responsibility to participate emotionally. Instead compassion values are sidelined and potential opportunities to dwell on victim coverage are replaced by images of fighting and violence."
(2) Ethnicity. How relatable are the victims? Although it can be argued that people in western countries would feel a lesser degree of compassion for victims of a bombing in Karachi, that doesn't mean people in countries near Pakistan wouldn't feel compassion for the Karachi victims at a level comparable to what westerners might feel about a bombing in Toronto. Distance has a role to play in this dynamic as much as in the sound evolutionary data that demonstrate a need for us to both recognize and empathize with people who look like our communal entity. It's not racism; it's tribalism. We are simply not evolved from massive heterogeneous cultures. As evolving humans, we're still working it all out. It's a survival mechanism that developed over millennia that we now struggle with as we fine tune our trust for others.
In the end
Think of compassion collapse on a grid, with compassion represented in the Y axis and the number of victims running along the X. As the number of victims increases beyond one, our level of compassion is expected to rise. Setting aside other variables that may raise compassion (proximity, familiarity etc.), the level continues to rise until, for some reason, it begins to fall precipitously.
Is it because we've become aware of being overwhelmed or because we have reached max-capacity neuron load? Dunbar's Number seems a reasonable place to look for a tipping point.
Professor Dunbar has referred to the limits of friendship as a "budgeting problem." We simply don't have the time to manage a bigger group of friends. Our compassion for the plight of strangers may drop of at a number equivalent to the number of people with who we can be friends, a number to which we unconsciously relate. Whether or not we solve this intellectual question, it remains a curious fact that the larger a tragedy is, the more likely human faces are to become faceless numbers.
SMARTER FASTER trademarks owned by The Big Think, Inc. All rights reserved.