WhenWise Regression Test Suite Reaches 500 Selenium tests and ~300K Test Executions

Share WhenWise’s CT process, which enables daily deployment to production.

Today (2021–03–05), I reached Level 4 of AgileWay Continuous Testing Grading for my WhenWise app: 500 end-to-end/user-story-level (Selenium WebDriver) tests in the regression test suite.

This is my second time to reach Level 4. The first time was for ClinicWise on 2016–07–29.

Parallel Test Execution

A big challenge of executing automated end-to-end tests (in browsers) is the long feedback, as running a large number of UI tests will take a long time. In the case of the WhenWise regression test suite, it will take 4+ hours if running on a single machine. The only practical solution is parallel execution.

Running this suite in 9 BuildWise agents (concurrently) will only take ~35 minutes. Besides time-saving,