Strike the hot iron of change.
The Iron is hot. We need to strike it to prevent future tragedies and failures

Strike the hot iron of change.

The impact bad software can have on lives in incalculable ...

was the strapline I put on my article in September 2023 about the #PostOfficeScandal. The victims, both direct and indirect, are now having their voices heard. Action is finally, belatedly, some might suggest grudgingly, being taken. Quashed convictions and full financial recompense will, hopefully, soon be forthcoming, although nothing can compensate for the lost homes, good standing in communities, childhoods, relationships, livelihoods, businesses, lives!

We don't need QAs or testers ...

is the claim being made by many in the software industry over recent months and, in some cases, years. The #PostOfficeScandal has many contributing factors:

  • the honesty and integrity of management at all the organisations involved,
  • the obfuscation of evidence during prosecutions,
  • the willingness of politicians to listen to the issues raised and hold people to account
  • and many others.

However, fundamentally, the Horizon software was not fit for purpose on many levels. Without those defects, the prosecutions would not have been necessary, the lives would not have been ruined, the whole, sorry scandal could have been avoided. Testing of requirements and prevention of defects is possible as I described in my article about Throwing Bad Money After Bad.

Every system released has bugs in it ...

is another argument, which has some validity. As a former developer, I know that I've sent my share of bugs into the world. That is not a reason, though, to render mute the need to test. Neither is it a reason to take the risk that the product owner and developer, however skilled and experienced between them, will always get "it" right.

We have yet to see the defect reports from Horizon and to be able to understand the root causes of the resultant imbalances or how, following a process given to a subpostmistress by the "help desk" resulted in an erroneously negative value doubling, instead of going to zero, or any number of other failures in the system.

Testing just slows releases down

I've heard from more than one project manager or owner over the years, normally when the project is up against it, when gaps in understanding of what has been asked for have been revealed in business testing or, even worse, on release when things have had to be backed out, needing re-work at the last minute, missed deadlines, failed integrations and others.

I've also been part of an organisation that saved their business by bringing not just testers but members from across the organisation into a process intended to remove ambiguities and omissions from requirements/user stories/features prior to development. I've been part of embedding QA and Test resource into 3 Amigos squads which helped transform weekly releases to multiple releases a day. In both these cases we improved the time to market figures, reduced the cost of producing the finished product, enabled to the developers to spend more time developing new features, reduced the context switching required to fix defects, since they weren't there and raised morale across organisations.

Now more than ever ...

the software industry is going to be under scrutiny.

  • What were the processes that could/should have stopped the #PostOfficeScandal from happening when the software was produced?
  • Why did the system for Covid test and trace fail in its primary objective at huge cost?
  • How is it that a lack of "What If Thinking" meant that a simple process to put a flawed flight plan into an alert queue, leaving the rest of the National Air Traffic System processing normally, was missed?

The paying public rightly expects that the software they pay for, rely upon, and use moment by moment daily will have been tested and shown to work before it is released into the world. We don't signoff buildings, drugs, vehicles or any number of other things, failure of which can have fatal consequences in the way we release software into the world, the failure of which can have fatal consequences.

The iron of change is hot

Now, perhaps more than ever, the software industry needs to look to the order in its own house. To recognise the need for all the 'traditional' software development disciplines, which includes QA and Test. To use those disciplines in the way that is most effective to deliver the greatest value to their customer base. To recognise that Quality can lead to business advantage, to be bringers of customers through confidence in the products we release, not simply a "cost centre", perceived as slowing down those releases and adding no value.

I've written my MP and contacted Gareth Davies, Comptroller of the National Audit Office, recommending that an agency be established to "opine on the appropriateness of methodologies for the?development of systems funded from the public purse". I believe that there will be public and political backing for such an agency in the light of the projects listed above.

Additionally I, along with many in the testing community, believe that we have need of a professional society, recognised as an institution akin to the organisations who are members of the Engineering Council, making a recognised "Profession" of our discipline. Many are adopting the "Test Engineer" or similar as a job title. If that is what we wish to be known as, let's do what Civil engineers, Mechanical Engineers and other professions do. Paul Gerrard is working towards creating the Test Engineering Society to "promote the importance of Test Engineering in the wider engineering community and provide a framework for engineers to achieve professional registration."

"The death of Testing" has been announced on numerous occasions. The tragedy of the Post Office Scandal has raised public and corporate awareness of the vital role for QA and testing should play. Let's seize that opportunity to show how a thriving and vital QA and Test profession can deliver huge benefits, industry and society wide.

Mark Gilpin

Enterprise Architecture | IT Strategy | Architecture Practice | Agile Operating Model

1 年

I would agree but also say that such issues can also occur when projects or products try and skip solution architecture as that can lead to poorly structured code and a lack of clarity of the role of each software component. Getting IT right is not magic as best practices have existed for decades! I have also worked with many experienced professional IT staff that do a good job day in day out.

回复
Kate Green

Director of Greenbird Web Design, Bookkeeper, Drama Teacher

1 年

Excellent article. Really important points about how testing software is as vital as testing a car based on recent events!

回复
Mark Kendal

Helping you use technology to grow your business, increase productivity & save you time & money with a bespoke answer to your needs.

1 年

Thanks Martyn, some excellent stuff there. I'm not primairly a testet and, to be honest, even when I was involved in development at an enterprise level was like many developers - i.e. I saw "test" as a four letter word.!However, we do need to take this stuff seriously. Defining success criteria at the outset of a project and for each part of the project is so important. Then ensuring that those criteria are met. I guess also accepting that there is a real cost to ensuring that code does what it's supposed to. I guess this is just a very long winded way of responding to your artcile by saying - YES!

回复
Paul Gerrard

Eminent Software Consultant, Author, Teacher and Coach

1 年

Thanks for the shout-out Martyn. Since 1996 or so when, with Dorothy Graham, we started the ISEB test certification scheme, it was always seen (at least by the initial working group) as the start of a broader 'Professionalism in Testing' initiative. In the intervening years, ISTQB has succeeded commercially, but has not taken the same view, limiting itself to certification. We need something better. The Test Engineering Society is an attempt to establish a professional institution, aligned with the Engineering Council principles (like 39 other engineering bodies) that is open to all testing practitioners to provide a 'home' and focus. It will provide events, training, mentoring, information, guidance and support to practitioners wishing to advance their careers, and ultimately, become registered professionals - just like Civil, Electrical, Mechanical engineers. We have a website - https://testsociety.org - but it is still under development - so please be patient. Right now, we are seeking expressions of interest - supporters - who at least want to be kept informed, but might want to be more closely involved in some way. If you are interested, please use this form to get in touch: https://testsociety.org/utilsInterest.

Alan Julien

Manager of Quality Assurance at MED2020 Health Care Software Inc.

1 年

Martyn Walmsley Fantastic Article!

要查看或添加评论,请登录

Martyn Walmsley的更多文章

  • Is 14 so significant to me now?

    Is 14 so significant to me now?

    I've seen an emerging trend of requesting information on the socioeconomic background of job applicants, along with…

  • Is that clear for everyone?

    Is that clear for everyone?

    Software is, fundamentally, a translation exercise. But what if our intent is unclear? What if there are omissions in…

  • How PETS can help you deliver.

    How PETS can help you deliver.

    Assistance animals have been helping people for a number of years but family pets in the office are a recent sight…

    1 条评论
  • How "Waterfall" is your "Agile" process?

    How "Waterfall" is your "Agile" process?

    One day last week, the first full week in October 2023, I replied to two posts. One post, about #communication and…

  • A little "What if?" can save a lot of "What on earth!"

    A little "What if?" can save a lot of "What on earth!"

    I've just had a conversation with my MP about the National Air Traffic Service (NATS) system failure in August. As with…

  • Throwing Bad Money after Bad

    Throwing Bad Money after Bad

    The UK government, in the person of Business minister Kevin Hollinrake MP, has offered £600,000 in settlement to…

    18 条评论
  • The OUTCOME, not just the outputs.

    The OUTCOME, not just the outputs.

    Everything we do has an intended outcome, be it at the macro or micro scale. However, everywhere I've worked, be it in…

  • Savoury crackers and Quality.

    Savoury crackers and Quality.

    Those of us who do "tech" for a living are likely to have been in that conversation that starts with a variation of…

    4 条评论
  • Using EMAIL for team development.

    Using EMAIL for team development.

    We're all part of numerous groups, be they familial, social, professional or others and within each of these groups…

    4 条评论

社区洞察

其他会员也浏览了