Case Study: Rescue Unreliable 20 hours of Automated Regression Testing in Jenkins ⇒ 6-Minute Highly-Reliable in BuildWise CT Server

Convert unreliable tests in self-created Java/Groovy ‘framework’ to raw Selenium WebDriver in Ruby; Switch Jenkins to BuildWise to execute the test suite.

The title might sound unbelievable, but this is a true story, there is a solid proof towards the end of the article.

About nine years ago, I joined a large tech company as a test automation engineer (contractor). On the first day, the division test automation lead expressed that he wanted me to rescue test automation in a high-priority project. He said: “We (including him) designed the test automation framework, but the tester in the team couldn’t develop and maintain the test scripts”. Hearing that, I had known a part of the problem for the project already. (Check out my article: Please, Not Another Web Test Automation Framework, Just Use Raw Selenium WebDriver).

Table of Contents:
· The Test Automation and CI/CD Mess
· The First Day
· The Rescue Proposal
· The Rescue
  ∘ Stage 1: Convert the key test cases to raw Selenium 
  ∘ Stage 2: Run these days daily in the BuildWise CT server
· The Result