Is Little Data The Next Big Data?
Jonah Berger
Wharton Professor, Bestselling Author of Magic Words, Contagious, Invisible Influence, and The Catalyst, Keynote Speaker, Consultant
Is personal quantification the next evolution of the Big Data revolution? And is our addiction to analytics leading us astray?
Three weeks ago, at approximately 10:32pm, Nike made me hit my dog in the face. Now before the ASPCA starts calling, it was a complete mistake (she snuck up behind me while I was furiously swinging my arm in circles). But the fact that it happened at all sheds light on how the recent quest for personal quantification has changed our lives, both for better, and worse.
The era of “Big Data” is upon us. From Target mining shopper data to figure out who is getting pregnant to Google using online search to predict incidence of the flu, companies and organizations are using troves of information to spot trends, combat crime, and prevent disease. Online and offline actions are being tracked, aggregated, and analyzed at dizzying rates.
The power of Big Data was on display, once again, at this week’s TechCrunch Disrupt conference, a biannual confab of some of the biggest players in Silicon Valley. Big data believer and Salesforce.com CEO Marc Benioff was there, as were plenty of venture capitalists betting on a future in businesses driven by data.
But while Big Data gets all the attention, innovative technologies have also enabled Little Data to flourish. Personal quantification. The measurement, tracking, and analysis of the minutiae of our everyday lives. How many calories we consumed for breakfast, how many we burned on our last run, and how long we spend using various applications on our computer.
In some ways Little Data is a boon. We can lose weight by realizing we tend to splurge on Thursdays. We can be more efficient at work by realizing we dilly-dally more than we thought on Facebook. With data firmly in hand we work to optimize every aspect of our behavior.
But this measurement also has some insidious aspects that we often ignore. We forget that what we track determines where we focus and what we are motivated to improve.
Why do people obsess over LinkedIn Connections or Twitter followers? SAT scores, golf handicaps, or even gas mileage? Because they are observable metrics that are easy to compare. Someone who has more LinkedIn connections must have more expertise. Someone with more Twitter followers must be more “influential.” So people use these metrics as a yardstick. An easy way to assess whether they are doing well.
But just because a metric is easy to capture doesn’t mean it’s the right metric to use. More followers don’t actually equal more influence. More connections don’t necessarily mean more expertise. They may just mean someone spend a lot of time on the site.
It’s like the old adage about the drunk searching for his keys. One night a policeman sees a drunk scouring the ground around a streetlight so he asks the drunk what he is looking for. The drunk says “I lost my keys,” and the policeman, wanting to be helpful, joins in the search. After a few fruitless minutes combing the area, the policeman asks the drunk “are you sure you dropped them here?" “Not sure,” the drunk says, “I have no idea where I dropped them.” “Then why are we searching under the street light?” asks the policeman. “Because that is where the light is,” the drunk replies.
And this brings us back to Nike, my dog, and swinging my arm around in circles like a windmill. Nike’s new FuelBand helps people track how much exercise they get on a daily basis. It records how many steps you take, calories you burn, and even “Fuel,” a measure of overall exertion. All on a handy tracker you wear around your wrist. You set a daily “Fuel” goal, and if you get there, the wristband gives you a mini-celebration.
The device is meant to encourage exercise, but like many examples of Little Data, it focuses attention on a particular aspect of behavior. Shining a light and determining where people devote their effort.
As a result, Fuel becomes the ends rather than the means. I was brushing my teeth, about to go to bed, when I noticed that I had 3,900 Fuel points. My goal for the day was 4,000. I was so close! I couldn’t go to bed without reaching my goal.
But it was 10:28 pm. Too late for a run or any exercise really. So I started doing a couple of half-hearted jumping jacks. Then I realized that arm movement burned the most Fuel. So I started swinging my arm around in huge circles. Just when the dog decided to walk up and take a closer look at what in the world I was doing with my arm.
Is Nike’s goal to get people to swing their arms in circles? Unlikely. But by tracking a measure that values such behavior, that is what it encourages. Searching under the streetlight.
Measurement is great. Without it we don’t know where we are, how we’re doing, or how to improve. But we need to be careful about how we use it. Because without realizing it, measurement determines rewards and motivation. It determines what people care about, what they work to achieve, and whether they cheat to get there. Tracking student test scores helps measure achievement, but it also encourages teachers to teach to the test.
So before you obsess over a particular metric, make sure it’s the right metric to obsess over. It might just be time to find a new streetlight.
Has Little Data and the quest for quantification gone too far? Is Big Data a boon or a bust? Share your thoughts in the comments below.
Jonah Berger is a Marketing professor at the Wharton School. His other recent posts include
- Miley Cyrus’ Best Career Move. Ever.
- Fuzzy Math: What Makes Something Seem Like A Good Deal?
- What Are Your Three Types of Ice?
Want to learn more about Big Data, behavioral science, and why things become popular? Follow him on LinkedIn (by clicking on the yellow box in the top right corner of this page), Twitter, or order his New York Times bestseller Contagious: Why Things Catch On
Director of Software Engineering @ Zebra Technologies | Software Development, Management
10 年Very well said!! Unless we measure ourselves, we do not know where we stand and how we are doing. If we set the objectives to our tasks, we achieve the tasks easily as we are completely determined. Moreover, it gives a personal satisfaction that we are able to do what we want to do.
CEO, CTO | producer, designer, manager, developer, creative, futurist | open source, web3, creator tools (music, composable assets, c2pa/provenance) | social good, metaverse, web3, creatives ~chain~of~creators~
10 年I'm all about Little Data! We can't improve the world if we can't improve our own lives!
Denver CO
10 年So far, I perceive Big Data as a bust. Not a single advertiser has managed to identify any of my biggest purchases last year, and shove something under my nose as an offer, during the process. Example - I spent over a year looking at cars, and finally acquired a new one in 2013. Not a single vendor caught on, despite dozens of hours of research. The local Toyota dealers are so clueless they are still trying to get me to trade in an old vehicle I no longer have. Two other major purchases were equally overlooked or completely missed by the data gatherers. Right now I am looking at two common household items, both in the $2,000 to $4,000 range - and no vendor seems to have figured that out, despite months of my looking. Best Buy ought to know..since I've been to several of their stores... but they don't. I have no doubt however, that once I make my purchase, some vendors will wake up and start emailing me offers. As far as I can tell, the presumed benefits of Big Data are 90% hype.
Deputy Chief Clinical Information Officer, Head of the Health Data Institute and Visiting Fellow in Computer Science University of Reading. Consultant ENT surgeon specialising in Paediatrics.
11 年This article resonates with healthcare: it is all too easy to make what can be measured a key metric. In Otology (the clinical specialism associated with the ear), much of the research uses pure tone audiometry (PTA) as a key outcome. PTA is conducted in a sound proof booth. It is quick to perform and is standardized across the world. It measures the impairment - hearing loss - but does not measure the disability or the handicap. The disability arises from not being able to discriminate speech in background noise. PTA does not measure this. In addition, certain types of hearing loss are associated with loudness recruitment ( nonlinear response to loudness growth), narrow dynamic range, distortion and loss of the ability to discriminate consonants. Whether the patient suffers any handicap depends on their environment. PTA is a universal test of hearing but it only samples a small part of the auditory function.