Artificial Intelligence (AI) and DevOps

https://www.cioreviewindia.com/magazines/automation-special-july-2017/ {Page 22}

If you work in the IT department of a company with SLA that ask for 99.6% availability, here is a scenario that may sound familiar to you. Customer calls at odd hours with some failing transaction issue or a information being processed wrongly, you ask your specialist from operation support team to look into the system immediately. What happens afterwards is known to everyone- start looking into more than a hundred thousand messages logged at the set time-frame : resulting a data set impossible for a human being to review line by line. A trail and error resolution starts. With concept of DevOps emerging in recent time this problem is getting into gigantic proportion.The dramatic pace in which the processes, technologies, and tools are changing, it has become difficult to cope with such scenarios.Moreover, the pressure business users have been putting on DevOps teams is growing manifold , expectation is that everything should be solved within minutes.

"The big data generated out of the logs are not easy to crack with manual interventions."

So, what do we do with it and how sleepless nights can be avoided . How to find the critical triggering event without much of time pressure. Basically, we need something automatic,which can pinpoint the problem location in the high volume of logs and help in resolving the current issue . Essentially, reducing the problem investigation cycle time to find root cause and avoid recurrence. This is where Analytics with artificial intelligence capability finds a foothold.Combining big data, AI, and domain knowledge, technologists have been able to create big breakthroughs and opportunities for the DevOps teams.

"AI is no more a buzzword or fiction. It is substantiating the incapability of human mind to handle speed, complexity and quantity of the data and helping to optimise the root cause analysis."

So how it is working?- it does basic algorithm stuff like - how a user investigates, monitors, and troubleshoots events, and allows it to develop an understating how humans interact with data and conclude. Some higher level solutions are being propounded as well with bringing in the concept of cognitive thinking in system.This technological concept offer to use machine-learning algorithms to match human domain knowledge with log data, along with repositories, discussion forums threads. Using all this information, it makes a big data of relevant insights that may contain solutions to a wide range of critical issues, faced by IT DevOps teams on a daily basis.The core of these cognitive insight is based on the ELK stack, it sorts and simplifies the data and makes it easy to have clear picture. Even a lot of security solutions to keep hackers at bay is now a days being deployed with similar concepts.

Using AI driven log analytics systems, it becomes considerably easy to efficiently solve issues. Such a system will definitely have a considerable impact on DevOps. ELK is fast becoming the trend and Many reputed vendors are proactively researching and testing AI to bring in automation and providing logging solutions .I don't wish to mention any name but can be found easily with the help of search engines.It has become a good solution for companies to create a setup without incurring astounding upfront cost. 

In summary, integrating AI with log management is way to go for DevOps and can bring efficiency , risk management, optimization in data management and trouble shooting and in the end customer delight . The endless wait of solution and root cause analysis , daily chorus of ticket priorities and SLA breaching could be a history.