BA - What just happened?
From the IT rumour mill:
Allegedly, staff at the data centre were told to apply some security fixes to the BA computers. The BA data centre has two, parallel systems to cope with updates. What was supposed to happen was that they apply the fixes to the computers of the secondary system, and when all is working, apply to the computers of the primary system. In this way, the programs all keep running without any interruption.
What they actually did was apply the patches to all the computers. Then they shutdown and restarted the entire data centre. Unfortunately, computers in these data centres are used to being up and running for lengthy periods of time. That means, when you restart them, components like memory chips and network cards fail. Compounding this, if you start all the systems at once, the power drain is immense and you may end up with not enough power going to the computers - this can also cause components to fail. It takes quite a long time to identify all the hardware that failed and replace it.
So the claim that it was caused by "power supply issues" is not untrue. Bluntly - someone with a lack of imagination shut down the power.
Would this have happened if outsourcing hadn't occurred? Probably not, because prior to outsourcing BA had employees who were experienced in maintaining BA computer systems, and knew instinctively what the proper procedures were.
In the language of PR disasters: "Lessons will be learned. Let's not dwell on the past." etc.
Gone Sailing........
7 年Outsourcing mission critical IT, Hmmm there's a concept!!
Chief Technology Officer - Strategy | Transformation | Integration | Disruptive Technology
7 年Sadly, the real truth here is NOT that it is caused because it was outsourced! It is always easier to blame someone else. The situation was caused because they believed they had outsourced the risk rather than just the man power. This clearly resulted in a lack of control and process from the core team! That is the REAL issue! I don't usually comment on here but I feel strongly that until people are truthful with themselves they will not fix the issues. Always ask what you did wrong before blaming others.
Consultant Solutions Architect | Enterprise Architecture, Technology Strategy
7 年Unfortunately this again is points towards another case highlighting the downsides of offshore resources completing complex tasks. People will remember a similar set of upgrade tasks given to another group of offshore resources which resulted in RBS group being offline for days. Before I am criticised I fully support a balanced IT resource model however, on shore resources will remain more qualified and less risky in performing high skilled and complex tasks.
Broadcast/Media Technology Sales Specialist
7 年Mark, I think the question is, was there anybody in the DC?
Was there that many morons in the DC?