Determining the Reliability of Critical Controls in Construction Projects
This study analysed 10 years of serious and fatal incident investigation reports from four international construction companies to:
i)??????????????????? Assess the reliability of their Critical Controls (CCs)
ii)?????????????????? Assess the factors that affect the reliability of CCs
?
I’ve skipped a lot – so check out the full paper.
Providing background:
·?????? The authors in a prior paper proposed that the construction industry should focus more on risk treatment and applying a CC approach to preventing fatalities, and learn from similar programs in oil & gas and mining
·?????? CCs are “specific safety barriers, which (i) directly prevent the unplanned release of energy, which cause major accident events, (ii) directly prevent the escalation of event consequences or (iii) are unique controls within an event pathway event”
·?????? Several factors influence the reliability of controls, including organisational psychological mechanisms (e.g. confirmation bias, normalisation of warnings, group think/consensus)
·?????? Prior work identified control performance as a product of reliability in the control to perform within the work environment and the adequacy of the control to prevent or mitigate unwanted events
·?????? Based on regulatory data, its highlighted that between 85 to 90% of construction fatalities “are events occurring from common high-risk activities, where controls that prevent the incident are defined within organization safety management systems, but still result in single to two-person fatalities”
·?????? And these fatalities “continue to be caused by the same high-risk activities and hazards due to
·?????? failures in control reliability and less from novel or abnormal situations, where they are not
·?????? defined or are inadequate in preventing the novel events conditions”
·?????? They argue that “In the simplest form, the effectiveness of a risk control is the ratio of the number of failures of the control when challenged to the number of occasions the control was challenged”
·?????? Control reliability is also a factor relating to the type of barrier being used and the “interdependency on human action and the effectiveness of the safety management system supporting the reliability of the barrier”
·?????? Their process for measuring and assessing control performance are shown below – check out the paper for the full description
领英推荐
?Results
Based on the sample, 186 serious and fatal event investigation reports were collated between 2011 – 2019.
The most frequent major accident events (MAE) included driving interactions, lifting operations (dropped load), uncontrolled energy release, and falls due to access/egress from plant or unstable ground.
CC performance measures
Implementation of CCs across all MAE categories was found to be an average of just 57% (but with considerable variation).
Hence, just 42% of CCs were assessed as implemented and effective on average.
Effectiveness of CCs when implemented averaged 41%.
When implementation and effectiveness were assessed by MAE, mobile equipment and lifting operations had the strongest CC implementation rate. Stored energy had the lowest implementation rate overall.
Below highlights average control performance.
Engineering controls had the strongest rate of implementation, and engineering and administrative procedural CCs had similar effectiveness ratings. Engineering controls have greater monitoring by field construction personnel as part of monitoring integrity, so hence they tend to be better implemented.
While stored energy CCs consistently rated lower than other MAEs for implementation, they delivered a higher rate of effectiveness.
In summary:
·?????? “All four major-accident event categories were found to have a high proportion of weakly or not implemented Critical Controls and, therefore, were not effective in preventing the release of hazardous energies”
·?????? The CCs that were rated as ‘weak’ (indicating <50% reliability), were considered unreliable as they “failed more times than the CC was effective”
·?????? When considering all of the findings, “the CCs that had a high reliance on human performance (e.g.,
·?????? operating plant and vehicles, inspections, maintaining exclusion zones) had a higher rate of failure … which aligns to hierarchy of control principles”.
Authors: Selleck, R., Hassall, M., & Cattani, M. (2022). Determining the reliability of critical controls in construction projects. Safety, 8(3), 64.
HSE Leader / PhD Candidate
11 个月Vincent Theobald-Vega, Sergey Kharitich - Responding to your posts together since you both mentioned the same limitation. Yes, this limitation was mentioned in the paper, in that it's only looking at failures and not the whole spectrum of work. My second audit study also had the same limitation - we only studied the instances when bad things happened and were subsequently studied, rather than the thousands (millions?) of instances when things went according to expectations.? This is a challenge across industry - most of our detailed intel on work and safety is based on incidents--unsafety--rather than the presence of safety. Interestingly, the NASA article I just posted also observed this to be a major limitation in commercial aviation in that most of our data relates to the rare instances when things go wrong, rather than all of the constant adjustments people make to create safe and reliable work.
Experienced Safety Executive and Consultant
11 个月Although this paper has a serious restriction, in my view, namely that it studied only (material) unwanted events to see the efficiency percentage of CC"s, not the whole processes and implementation of CC's when there were no events, one can only guess what the efficiency of all other controls might be when CCs' efficiency is less than 50% :)
Author, Safety Leadership and Outdoor Adventure Fiction
11 个月42% effective! Ugh. Makes you wonder how many of the leaders actually made it out to the front line. I can be hard to see the difference between 84% effective and 97% effective on a leadership walkaround, but not 42% vs 97%. Just released my book on how to know and close that gap, SAFE AND I KNOW IT.
Health & Safety - Expert Witness and Consultant | FIIRSM, FRSPH, MISTR, EurOSHM
11 个月The effectiveness of the controls is biased as the study was a study of events. Controls have been most effective when there was no event. However, some very interesting findings. Thanks for the summary, I will now read the full paper with real interest.
Director @ Mineplex | SSE - Coal, Mines & Quarries | Risk Management Protagonist | Free-Range Pig Farmer
11 个月Thx Ben. I'd love to hear from the authors how many of the events were single and how many were multiple fatalities. Dr Roberta Selleck Maureen Hassall Marcus Cattani