Big Data - to absolutely any one
Nirupam S D
Chief Technology Officer (CTO) - Data Fusion, Internet of Things (IoT) and Artificial Intelligence
There are some things that are so big that they have implications for everyone, whether we want them to or not. Big Data is one of those concepts, and is completely transforming the way we do business and is impacting most other parts of our lives.
What is Big Data
“Big Data” means different things to different people and there isn’t, and probably never will be, a commonly agreed upon definition out there. But the phenomenon is real and it is producing benefits in so many different areas, so it makes sense for all of us to have a working understanding of the concept.
The basic idea behind the phrase 'Big Data' is that everything we do is increasingly leaving a digital trace (or data), which we can use and analyse. Big Data therefore refers to that data being collected and our ability to make use of it.
Some of them don’t like the term “big data” for a lot of reasons, but it seems we’re stuck with it. It’s basically a term for a very real phenomenon – the datafication of our world and our increasing ability to analyze data in a way that was never possible before.
Of course, data collection itself isn’t new. We as humans have been collecting and storing data since 18,000 BCE. What’s new are the recent technological advances in chip and sensor technology, the Internet, cloud computing, and our ability to store and analyze data that have changed the quantity of data we can collect.
Things that have been a part of everyday life for decades - shopping, listening to music, taking pictures, talking on the phone - now happen more and more wholly or in part in the digital realm, and therefore leave a trail of data.
The other big change is in the kind of data we can analyze. It used to be that data fit neatly into tables and spreadsheets, things like sales figures and wholesale prices and the number of customers that came through the door.
How is it being used
As with any leap forward in innovation, the tool can be used for good or nefarious purposes. Some people are concerned about privacy, as more and more details of our lives are being recorded and analyzed by businesses, agencies, and governments every day. Those concerns are real and not to be taken lightly, and I believe that best practices, rules, and regulations will evolve alongside the technology to protect individuals.
But the benefits of big data are very real, and truly remarkable.
Most people have some idea that companies are using big data to better understand and target customers. Using big data, retailers can predict what products will sell, telecom companies can predict if and when a customer might switch carriers, and car insurance companies understand how well their customers actually drive.
It’s also used to optimize business processes. Retailers are able to optimize their stock levels based on what’s trending on social media, what people are searching for on the web, or even weather forecasts. Supply chains can be optimized so that delivery drivers use less gas and reach customers faster.
But big data goes way beyond shopping and consumerism. Big data analytics enable us to find new cures and better understand and predict the spread of diseases. Police forces use big data tools to catch criminals and even predict criminal activity and credit card companies use big data analytics it to detect fraudulent transactions. A number of cities are even using big data analytics with the aim of turning themselves into Smart Cities, where a bus would know to wait for a delayed train and where traffic signals predict traffic volumes and operate to minimize jams.
Why is it so important
The biggest reason big data is important to everyone is that it’s a trend that’s only going to grow, as the tools to collect and analyze the data become less and less expensive and more and more accessible