Three insights from social data
Social data is powerful, goes the saying. But how can abstract data, tweets, likes and repins, tell you anything about an individual, a group or the world?
I have heard from marketers that they doubt the value of social data. Although Apple’s acquisition to Topsy should tell us something different. Apple sees massive value in social data.
And McKinsey’s robust assessment that social technologies combined with big data could release around $1trn in value across consumer goods, financial services, manufacturing and professional services alone.
There are three classes of insight one can derive from social data.
- Least valuable are 'on-social' insights (how many likes someone has, or might get);
- More valuable are inferring otherwise expensive to discover traits (like whether a person or group of people are early adopters, or influential in referring products);
- Most useful are predictions of states we can't otherwise measure (like predicting the success of given meme, product or movie; or forecasting future stock price movements.)
Through techniques of statistics, in its big data form, machine learning, researchers are developing models to predict many non-trivial features in the last two buckets of insights. Helping us unearth expensive-to-find traits about audiences; or to make predictions about future events.
The PeerIndex science team came up with the following examples:
Predicting influence and strength of relationships:
Predicting who influences who on social media has several potential application areas where it can create huge value - specifically in marketing channel optimisation. Which people should marketers influence (and how) in order to maximise the onward spread of their message?
In this important study Bond et al. investigated the role social influence plays in political mobilisation. Their key finding: “The social messages displayed on Facebook walls directly influenced political self-expression, information seeking and real-world voting behaviour of millions of people.”
Combine this with the fact that it is possible to predict your political orientation quite easily, social data will probably play an increasing role in elections and political campaigns in the future.Yes, beyond canvassing for votes and mobilising, MoveOn style, but in the targeting, prediction and optimisation of messaging and campaigns.
PeerIndex investigates product influence on social networks. Dr Ferenc Huszar, who leads our data science efforts, says "Inferring influence has clear value to consumer brands, as it allows them to find people whose referral value is high. Companies have been focussed on Customer Lifetime Value, which is defined as the cumulative profit or revenue from the customer’s purchases in the future. Now they will be able to combine their data with social data to understand Customer Referral Value, a much more powerful indicator that tells you how much value a customer creates by their own purchases and through the value of customers they would refer." Huszar writes about customer referral value on Harvard Business Review.
Predicting trends and adoption rates:
One powerful use of social data is to predict product adoption rates. MoviePilot predicts film success by target market through looking at Facebook likes. This paper demonstrates how one can forecast box-office revenue based on Twitter activity.
A number of companies (including us, PeerIndex, and Dataminer) are looking at detecting emerging trends on twitter before they are trending in mainstream audiences. These type of forecasts, when automated at scale, have tremendous value for brands who want to optimise their marketing or identify new opportunities.
Predicting personality and other traits:
University of Pennsylvania researchers recently demonstrated they could predict users gender and other personality traits by looking at Facebook likes.
IBM is experimenting with targeting ads based on people's personality types. And they are modelling personality by looking at twitter streams.
For marketers, understanding personality traits of target audiences could be a powerful input into the marketing plan. Understanding softer attributes about customers could shape product development, naming, packing, pricing and marketing communications.
Predicting other events
Wang et all use language models over twitter to predict hit-and-run crimes. DataMinr analyses twitter to find signals that might affect stock prices - before they become traditional news.
Social data is valuable, why don't people think it is?
Strangely, it's about signal-vs-noise. Companies tend to see first order social data, that is likes, followers and retweets. It is hard to prima facie connect these to business outcomes.
The second and third-classes of social insights (the harder to predict but more actionable) are simply rarer. So the market chatter about real insight is drowned out by the trivial, and more commonplace.
However, as smart companies like Apple, start to make bets on the value of social data, you can be certain the others will follow.
I'd be fascinated to hear of other examples, where large firms have used these 2nd and 3rd classes of social data to change business decisions. Comments below, most welcome; or directly on twitter.
Thanks to Dr Ferenc Huszar for help in compiling this post. Photo: AFP via Getty Images.
Oil & Energy Professional
10 年Excellent!
Iteration Manager, SPC
10 年Some non traditional aspects to take in to consideration when analyzing a business. Thanks for posting them.
There are companies out there that already measure who's sharing your product information, and more importantly, how many people view the information that's shared. By figuring out who the patient zero of your viral content is, you can see who's helping get your message out and give them more information to share.
Business Management and Operations
10 年I agree that "Most useful are predictions of states we can't otherwise measure (like predicting the success of given meme, product or movie; or forecasting future stock price movements.)" But this is a hard task to accomplish and can only be verified by a long, successful historical track record. How much historical data would one need to accurately predict social trends? I find this quote and link to be terrifying: "Wang et all use language models over twitter to predict hit-and-run crimes;" it sounds like a new form of surveillance based on discrimination. I want to hear more about this: "DataMinr analyses twitter to find signals that might affect stock prices - before they become traditional news." The DataMinr link leads to an auction page so I was not able to find out much, so far. If you go to dataminr.com you find the actual website. I work with PredictWallStreet a company that aggregates stock market predictions and produces stock market forecasts based on our patented proprietary algorithm (aka: our "special sauce"). Since 2005, www.PredictWallStreet.com forecasts have beaten the SPY by 10.89% annually. The criticism I hear people say most often is that "it is impossible to predict the stock market." It is true that one cannot accurately predict the movement of the stock market 100% correctly 100% of the time-but over a long period of time one can predict accurately enough, enough of the time, to make a large return in profit. Using the wisdom of the crowd to gather and analyze data is much more accurate than solely relying on an individual’s predictions. PredictWallStreet believes in the power of collective intelligence. By using real-time sentiment data combined with historical data we are able to produce forecasts that have historical data dating back to 2005. What are your thoughts on predictions of states? I am interested in learning about other companies working on similar projects/in similar fields.
Assistant General Manager (New Initiatives) at State Bank of India
10 年Intriguing...