Can Defect Density have a UCL?
Manav Ahuja
Author | Founder & Managing Partner @ Stratgyk | Rewriting the Dreams, Deals, and Disasters playbook for Small and Medium Businesses
While doing my usual morning readings, in a totally separate context, i had a question that started to haunt me. I tried to ignore but then the urge to think about it got stronger every fleeting minute. Question was/is - about Defect Density(DD)? Can DD have a UCL, if so,Why it should?
Defect Density - Total number of confirmed Defects / Size
I started to retrospect on experience i have gained, learning's i learnt and start to contemplate on basic problems - (a) Size estimations are 'estimations' (b) Total number of confirmed defects - involve a good degree of subjectivity and ignore value of "criticality of a defect".
My perspective on assigning UCL to DD? i strongly think that since LCL & UCL are benchmarks set for a certain metric to track that means they imply - At least and At Max. W.r.t DD which is basically a measure of Code quality more than tester's ability to find defects.
From testing perspective, it perfectly makes sense to say that we will find atleast x% defects (read LCL). But when we start to call out that from very same testing perspective this is the Max defects we can find, we start to tread a wrong path. Isn't it? Because there is no heuristics, no model, no methodology to tell the max limit of defects testing team (or tester) can find. Alternatively, we can always calculate the Defect Injection rate (the total minimum # of defects that will be there)...but NEVER MAX.
Even a developer cannot give a commitment to the max defects that can be found in his/ her code. Hence my opinion has it that no matter what we can never set a benchmark for Max defect density (UCL). If that’s the case, then WHY is it that while formulating the SOWs, SLAs we always put a LCL & UCL for Defect Density as well?
Is it not the time for a challenge to our canned approach? Thoughts...