Big Data and Analytics Trends for 2019

Having worked on looking and analysing trends since 2013, I have been thinking if we are approaching trend predictions the ‘right’ way. Data is no longer small so BIG is the norm. If BIG Data will just become Plain Data in 2019, what does this trend mean to anyone of us, as individuals and as a business?

Artificial Intelligence (AI) has been trending over the past year and will continue trending into the coming year. This word is no longer hype, it is here to stay. The definition of Artificial Intelligence is Non-Biological Intelligence. This would primarily fall under automation and usually refers to our virtual confidants such Alexa, Siri, Waze etc. With AI, predictive analytics is made more effective although this technology has been around for a while. The most sought out role in ‘Plain’ Data Analytics is the AI expert. This will not go away any time soon. In fact, demand is projected to only increase exponentially in the future.

Automation is a hot topic because of potential job loss. Robotic Process Automation (or RPA) is an emerging form of business process automation technology. For example – if you receive an invoice, it would automatically put it in Microsoft Excel for you.

According a new report from the World Economic Forum (WEF), AI and Machine Learning is expected to create 133 milliom new roles but cause 75 million jobs to be displaced by 2022. In ASEAN alone, as many as 28 million job losses can be expected by 2022.  Agriculture will be the sector hit hardest in this region but sectors that we would be seeing demand for new workers are wholesale and retail, manufacturing, construction and transport.

How much could businesses potentially save by adopting Automation? According to the WorkMarket 2020 In(Sight) report findings, 53% of employees stated that they could give up two hours a day through automation and 78% of business leaders said that automation can free up three hours a day. If I used an example of an average company with 500 employees in the US, they could potentially save up to USD 4 million per year.

From the perspective of an average employee, imagine that in a 40-hour work week, you could potentially save 10 hours and work on your career development and personal growth (that we all complain that we don’t (ever) have time for).

The new year would also mean the fading of Hadoop, ETL and Machine Learning. Yes, you read me right – Machine Learning. Bye-bye machine learning, welcome Automated Machine learning (AutoML). Huh? You might ask. Manually constructing a machine learning model is a multistep process that requires domain knowledge, mathematical expertise and computer science skills – which is a lot to ask of one company, let alone one data scientist (provided you can hire and retain one). Not only that, there are countless opportunities for human error and bias, which gets in the way of model accuracy and devalues the insights you might get from the model. Automated machine learning enables organizations to use the baked-in knowledge of data scientists without having to develop the capabilities themselves, simultaneously improving return on investment in data science initiatives and reducing the amount of time it takes to capture value.

In the wake of such demands of such skills, the Death of Fake Date Scientists will happen. This is a constant dialogue I have with businesses on how to get the right Data Scientist. I believe that the definition of one type of Data Scientist will die. We will see 8 categories of Data Scientists:

1. Those strong in statistics
2. Those strong in mathematics:
3. Those strong in data engineering,
4. Those strong in machine learning 
5. Those strong in business
6. Those strong in production code development, software engineering 
7. Those strong in visualization
8. Those strong in GIS, spatial data

We will be seeing more and more new roles within businesses, specifically roles that entail decision-making. To start off with, there will be the emergence of Chief Data Officers (CDO). There are a lot of talks on this. Classic roles such as Chief Information Officers (CIO) or Chief Technology Officers (CTO) will be replaced with CDOs. The role oversees the collection, management, and storage of data across an organization. They are responsible for analyzing and deriving insights from data to inform business strategy and value. They would be an integral part of the C-suite.

There is a huge demand now for Data StoryTelling. Google’s Chief Economist Dr. Hal R.Varian stated, "The ability to take data—to be able to understand it, to process it, to extract value from it, to visualize it, to communicate it—that’s going to be a hugely important skill in the next decades." And he said this in 2009, 10 years ago!

You have to tell the story with visualization. All the data in the world is useless – in fact it can become a liability – if you can’t understand it. Data Visualization is about how to present your data, to the right people, at the right time, in order to enable them to gain insights most effectively.

Our working styles will change considerably in 2019. Mobile First is already driving the ‘working from anywhere’ culture. It is not a new technology but now, all web designs and UI/UX out there will be designed to adopt mobile phones before it is worked on for desktops. This wasn’t the case even two years ago. Having real-time data and being able to make real-time decision on the go will be the method of working this coming year. It is not like it hasn’t started already!

I cannot talk about any of the above without looking at infrastructure and hardware support. With our lifestyles supporting this, Internet of Things (IOT) will just grow. It is not just in the manufacturing side but also in our everyday lives, from driving a car to home optimization. With the likes of Alexa, we could take charge of our lives in much simpler ways. Many would argue about having too much dependencies on such tools but hey, it is what it is… and it won’t go away. Because we as humans and this point in the century just want simplicity.

With the growth of IOT, Edge Computing has come to surface. There are huge debates if this will kill Cloud Computing. So to ease such concerns, let me briefly explain to you what is Edge Computing. Edge Computing enables processing data near the edge of your network where the data is being generated whereas Cloud Computing is a centralized data-processing warehouse. I believe the trend will be a hybrid solution whereby with IOT, Edge Computing would be essential and for business it would be Cloud Computing.

An analogy that I read recently and really liked illustrates my point perfectly which is the fear people had when TV came by that radio will die. I believe it will be the same. You and I still listen to the radio and we wouldn’t and couldn’t watch TV when driving (even if we wanted to!).

I also read about the emerging and sudden spike in interest for Quantum Computing. Bear with me, this is not new and has been extremely difficult to be built. They have been working on the technology for 10 years now. What I believe has happened now is that the likes of IBM and Google along with the top universities have combined their efforts to make this quantum competing have the opportunity to become a reality next year. But if this true, then the coming of Quantum Computing would actually kill the Blockchain technology. It will surely be interesting to watch this space for the coming year.

2019 will be a year that businesses won’t doubt the need of analytics in the decision-making process. There will be more and more investment in this area. The cost of analytics will go down because the major part of the investment has started at least three years ago. What remains the biggest challenge to businesses till today and will continue in the future is the challenge of getting TALENT. I constantly talk about the strategy around Human Capital will become the single most important strategy for a business to stay relevant. Businesses will and have to continue investing in re-skilling and upskilling their employees. Individuals will have to learn to unlearn and relearn. It is not the job lost that concerns me, it is the speed of it happening that worries me. Hence, “The illiterate of the 21st century will not be those who cannot read and write, but those who cannot learn, unlearn, and relearn.”