Member-only story

Why Don’t I Use Defect Tracking? No Need, I do real Continuous Testing.

Replicate a new defect with automated tests, then add it to the regression suite that runs in a Continuous Testing process

Zhimin Zhan
6 min readMar 3, 2021

Non-Medium-Members: You can read this article free on Vocal.

Those teams who are spending hours every day on a defect-tracking system (DTS), such as Quality Center, may get offended by the title of this article. Here, I borrow quotes from some of the world’s leading experts to support my view.

The answers to track/fix the bugs, from these three highly-claimed books, are the same: creating an automated test to replicate the bug, so that you don’t need to log it in DTS. Here, I would like to share my own experience of practising this in the past decades.

“Facebook is released twice a day, and keeping up this pace is at the heart of our culture. With this release pace, automated testing with Selenium is crucial to making sure everything works before being released.” — DAMIEN SERENI, Engineering Director at Facebook, at Selenium 2013 conference.

The bugs/defects I am referring to are the ones found by the IT team members. Those that are reported by the customers, of course, will be treated with high priority and may be recorded. For my own apps, I usually implement customers’ feature/change requests or bugs within the same day, so I don’t track customers' reported defects either. This is a fact, otherwise, I wouldn’t have been able to develop and maintain 6 complex apps

  • TestWise, next-gen functional IDE
  • BuildWise, an international award-winning Continuous Testing Server
  • ClinicWise, a cloud-based practice management system

Zhimin Zhan
Zhimin Zhan

Written by Zhimin Zhan

Test automation & CT coach, author, speaker and award-winning software developer. Help teams succeed with Agile/DevOps by implementing real Continuous Testing.

Responses (3)

Write a response

spring

Is that 'sprint'?

How do you distinguish a failed test due to bug vs due to existing defects? UI tests can tend to be flaky. Also, wouldn't the automation suite increase a lot if we create an automated test for each bug?

What metrics do you track to show your ROI - Return On Investment?
If I were to follow the advice of this article, my automation team would never get credit for finding any defect before the manual test team.
How do I justify my teams costs if I can't…