Big Data -The time to leverage the known -unknowns

Data is the new oil,which fuels the business's UN-known and bring up the stuff which has to be known

The world is growing at an enormous speed every moment, and at the same speed is growing the overall data size across the globe, which technically constitutes the term known as ‘Big Data’. Apart from big data, a yet another technological revolution that is taking the world by storm these days is ‘Artificial Intelligence’ or AI and ‘Machine Learning’.

The questions that helps in evaluating the need of Big Data implementation are:

• It starts with how big the Data is?
• Why we need Big Data platform to underpin the existing DataWarehouse?
• What are the inefficiencies its is going to fill?
• Who will get the benefits and how to pass on the benefit?
• Who will be the owner and who will be the stakeholder?
• In the era of Cyber security and identity theft-where will it be stored,what level of encryption and decryption it supports?
• In the realm of privacy (Post Cambridge Analytica Scam)- does the information captured is with the consent of data owner or is the data confidential or public?
• What is the timeline to establish the data ecosystem and how to leverage the platform?
• When will we start seeing the values post establishing the Big Data Ecosystem?

Then it comes to the Business Value questionnaire -

1. Which business problem -Top line or Bottom line we are targeting?
2. In terms of Government - How will this data can be leverage to pass the public benefits?How it will be helpful in understanding the demography,regulatory and supervision purposes ?
3. Is there a cost benefit in implementation of this Big Elephant( not Hadoop Elephant :P)

Answering to all this,there are many ways the organisations can leverage the Big Data and associate it with Multiple technologies.The good part of this era is the knowledge is available in plenty and its the dearth of human capacity one is not able to focus -what we want to learn and how can we connect the dots.

The power of free information is lack of focus.The word "Big Data" picks its hype from 2012,but still only few organisations are able to leverage it successfully and adds value to this ecosystem.Big Data is not a new phenomenon- its massively used in Space Exploration and Military surveillance from decades post World War 2 and surfacing of Turing Machine.

Success Stories

I wish to classify the success stories into two parts:

Earning the profit

Social Media platforms are capturing every information we post,analyse it and not started guiding us what can be good for us and who are our best Pals.They tracks like Big Brother and monitor our food habits,friends with whom we are hanging out and creates a persona.This persona is available for Sale to profit making companies which can leverage this information to sell you from Burger with specifications you like,to the insurance which is required as you have a new member or your parents becoming old or you got promotion,to the dress which will look good on you and if you are planning to party or vacation what is the good platform to book cab/flights/hotels which offers hefty discounts.

When you plan two three vacations or salary got increased they offer you personal loans for holidays as well with minimal fees (actual fees is hidden and can be surfaced once you fall in trap).Then if you are sick you start getting the ads for healthy food with articles posing to you so that you will change the habits along with workout places options providing discounts.

There is a expected growth of 200% in Data crunching jobs in these organisation and they are training to their employees to focus on AI,Blockchain,Machine learning so that they will utilize this Big Data platform created 5-6 years back.

Delivering Value to Ecosystem

in India, one can realize that now how their mobile phones are helping/assisting them to achieve anything they want with their life.It starts from Morning - Getting the best messages as popups in some channels which can be sent across to several Whatssap group, Suggestions of Cabs when your working hours started along with special offers of breakfast in between.When you reach office they will provide you market alerts and news alerts, along with guidance how to make your opinion over that by throwing a huge information and feels you proud that you are the person with up to date knowledge and have deep insights on all the day to day phenomenons.By the evening snack time,they will sponsor you cashback for movie tickets and popcorn along with special food festival nearby.

So are we too much exposed and people are taking advantage.My answer to this is No to an extent and reason for the same is how as human being we are evolving and According to Charles Darwin- " Evolution is the necessity for Survival and only fittest will survive in that".

How technology can be leveraged for the best :

1.Though it creates a threat to our identity,it can be leveraged to save it as well.

2. Through Machine Learning and Artificial Intelligence, Data is tamed to get the best of the possible juice.People should realize that this cannot be over and above our own reality.True reality has to be maintained.

3.Transparency in the system of governance can be achieved at great extent,one has the full visibility of how the data is utilized and what is the consequences of that.

4.Security is the great concern due to high exposure of information to vulnerabilities,but technologies like Blockchain, Cryptography ,Hash graph can provide a preventive layer to delay the insurgency.

The world has lot of skepticism about Big Data that it can be leveraged to produce a "Gods Eye"- who is not only watching us but also manipulates our action.To some extent yes,but the controllers of this ecosystem like Regulators,Governments,International Organisation should control this humongous source of Power and Money -the Data with appropriate measures and strict actions against those who breaches them.