How to compute % defects removed from release candidate code

Recently someone on StackOverflow.com asked me to explain how to compute the defect removal rate for release candidate software.  There are two methods for producing this number and I teach both in several of my seminars, but I’ll explain the simpler method in this post…

Lawrence Putnam presented this model in his 1992 Book titled Measures for Excellence.  His book reads more like a math text than a software development guide, and suffers from an unfortunate formula typo which has lead to widespread confusion about his models in the industry, but I will  explain his defect removal rate calculation process.  (I hired a math wizard to examine his data and correct the formula!)

1. For a typical project, code is produced at a rate which resembles a Rayleigh curve.  A Rayleigh curve looks like a bell curve with a long-tail.  See my ASCII graphics below:

||||
|||||||||||
|||||||||||||||||
|||||||||||||||||||||||

2. Error ‘creation’ typically happens in parallel and proportional to code creation.  So, you can think of errors created (or injected) into code as a smaller Rayleigh curve:

||||
|||+++|||||
||||+++++|||||
||||+++++++||||||||

where ‘|’ represents code, and ‘+’ represents errors

3. Therefore, as defects are found, their ‘detection rate’ will also follow a Rayleigh curve.  At some point your defect discovery rate will peak and then start to lesson.  This peak, or apex, is about 40% of the volume of a Rayleigh curve.

4. So, when your defect rate peaks and starts to diminish, factor the peak as 40% of all defects found, then use regression analysis to calculate how many defects are still in the code and not found yet.

By regression analysis I mean if you found 37 defects at the apex after three weeks of testing, you know two things:  37 = 40% of defects in code, so code contains ~ (37 * 100/40) = ~ 93 errors total, and your finding about 10.2 defects per week, so total testing time will be about 9 weeks.

Of course, this assumes complete code coverage and a constant rate of testing.

Hope this is clear.

Mike J. Berry
www.RedRockResearch.com

Share and Enjoy: These icons link to social bookmarking sites where readers can share and discover new web pages.
  • Digg
  • del.icio.us
  • Fark
  • Netscape
  • StumbleUpon
  • Technorati
  • YahooMyWeb

23 Comments »

  1. Trackback by RICARDO — July 20, 2010 @ 2:35 pm

    < blockquote >< a href=”http://medicamentspot.com/”>MedicamentSpot.com. Canadian Health&Care.Special Internet Prices.No prescription online pharmacy.Best quality drugs. No prescription drugs. Buy pills online< /a >…

    Buy:Lumigan.Prevacid.Actos.Accutane.Petcam (Metacam) Oral Suspension.Prednisolone.Zovirax.Human Growth Hormone.Mega Hoodia.100% Pure Okinawan Coral Calcium.Arimidex.Retin-A.Zyban.Nexium.Synthroid.Valtrex….

  2. Trackback by Dragons And The Blade Of Light Shadow DS/ — August 29, 2010 @ 2:58 am

    Dragons And The Blade Of Light Shadow DS/ http://copious-systems.com/tag/Emblem : Dragons And The Blade Of Light Shadow DS/…

    Emblem…

  3. Trackback by electric — August 29, 2010 @ 3:13 am

    Air http://vsigmavypok.AUTOTECHGUIDE.INFO/tag/engine electric Air/ : electric…

    engine…

  4. Trackback by tail — August 29, 2010 @ 3:18 am

    art http://ysafestzuxnh6o.AUTOTECHGUIDE.INFO/tag/art tail expedition/ : tail…

    art…

  5. Trackback by lift — August 29, 2010 @ 3:25 am

    sale http://amaclarymu.ACEHARDWAREE.INFO/tag/northern+industrial+cart+sale+lift+Lift/ : Lift…

    northern…

  6. Trackback by attendant — August 29, 2010 @ 3:31 am

    flight http://wtycodlo.ABABYCLOTHES.INFO/tag/flight+attendant+costume+high/ : attendant…

    attendant…

  7. Trackback by to — August 29, 2010 @ 4:00 am

    in http://abusinessvpt.BABYCLOTHESNUT.INFO/tag/Custom+Comforter+Sets+to+in/ : Custom…

    in…

  8. Trackback by Lamp — August 29, 2010 @ 2:34 pm

    Disposal http://kjvcnnwhwuy.BESTPARTSPLUS.INFO/tag/Tanning+Bed+Lamp+Disposal+airport+top/ : airport…

    Lamp…

  9. Trackback by Estate — August 29, 2010 @ 2:41 pm

    Real http://ubluetoothxf5.bestpartsstore.info/tag/Real+Estate+texas+homestore/ : texas…

    texas…

  10. Trackback by RAZR — August 29, 2010 @ 6:58 pm

    razr http://qmotorola5sejy.ALLSTOCKSPORT.INFO/tag/RAZR+Covers+razr+razor/ : RAZR…

    razr…

  11. Trackback by scratch — September 14, 2010 @ 8:57 pm

    scratch http://ro0.awr.ii33.co : bumper…

    service…

  12. Trackback by Alexander7 — July 22, 2011 @ 1:25 pm

    < b >< a href=”http://www.trustedpillspot.com/?ml=buy-generic-LEVITRA buy@generic.LEVITRA” >…< /a >< /b >< /blockquote >…

    Need cheap generic LEVITRA?…

  13. Trackback by tens Therapy — February 23, 2013 @ 10:27 am

    tens Therapy…

    How to compute % defects removed from release candidate code | blog.RedRockResearch.com…

  14. Trackback by surveillance camera systems — March 25, 2013 @ 4:12 am

    surveillance camera systems…

    How to compute % defects removed from release candidate code | blog.RedRockResearch.com…

  15. Trackback by Leon — July 27, 2014 @ 1:59 pm

    < a href = “http://google.com/?p=19&lol= smokes@regretted.charming”>.< / a >…

    good info!!…

  16. Trackback by Fredrick — August 22, 2014 @ 6:45 am

    < a href = “http://shop.reggaemp3.ru/?p=12&lol= hosaka@arlenes.mesh”>.< / a >…

    ??????????!…

  17. Trackback by Carl — August 22, 2014 @ 6:24 pm

    < a href = “http://cn.albumtary.ru/?p=4&lol= purchases@suddenly.proximal”>.< / a >…

    ???….

  18. Trackback by Darren — August 24, 2014 @ 1:01 am

    < a href = “http://org.albumgraph.ru/?p=39&lol= todman@tieck.tents”>.< / a >…

    thanks….

  19. Trackback by Claude — August 26, 2014 @ 10:31 am

    < a href = “http://com.mp3lane.ru/?p=30&lol= areaways@chattels.foals”>.< / a >…

    ????? ?? ????!…

  20. Trackback by Alvin — November 19, 2014 @ 2:52 pm

    < a href = “http://list.artistcove.ru/?p=20&lol= orient@giacomo.synchronized”>.< / a >…

    tnx!!…

  21. Trackback by william — November 20, 2014 @ 3:09 am

    < a href = “http://net.artistfeed.ru/?p=10&lol= remotely@whigs.crawl”>.< / a >…

    ñýíêñ çà èíôó….

  22. Trackback by Keith — November 20, 2014 @ 8:42 am

    < a href = “http://cat.artistmage.ru/?p=15&lol= overgrazing@domain.warships”>.< / a >…

    áëàãîäàðåí!!…

  23. Trackback by Don — November 21, 2014 @ 5:46 am

    < a href = “http://fr.songroad.ru/?p=41&lol= bloodiest@tribunals.soundproof”>.< / a >…

    ñïàñèáî!!…

RSS feed for comments on this post. TrackBack URI

Leave a comment

You must be logged in to post a comment.