Web Automation Framework Trend ⇒ Selenium WebDriver
The above is a slide in my Web Test Automation with Selenium WebDriver training, created in 2018.
Traditional Testing Tools
With the rise of Selenium WebDriver, there are generally three outcomes for those commercial testing tools (usually very expensive).
1. Change to support Selenium WebDriver
- HP QTP → Micro Focus UFT → LeanFT (supports Selenium WebDriver)
HP was “the industry leader” of test automation before selling its testing tool business to Micro Focus in 2017. Micro Focus is now a Selenium Level Sponsor of Selenium WebDriver.
2. Try to link to Selenium WebDriver somehow
Ranorex, SmartBear, Applitools, .., etc. are the Selenium Level Sponsors of Selenium WebDriver.
While these vendors are still selling their proprietary testing tools, they are sponsoring Selenium WebDriver. The message shall be quite clear.
3. Phasing out the market
IBM Rational Functional Tester (RFT) was the chosen test automation tool by the Gartner Report 2013. However, I haven’t heard RFT being mentioned in the last five years.
I used RFT before (~2013), and the tool was terrible and totally unnecessary. It did not run the test if your last opened IE window was on the second screen! Here is a related support ticket: “Rational Functional Tester support policy for dual screens” on IBM’s support site, still unresolved (last updated: 2018).
Frustrated, I created a Java project in RFT (effectively Eclipse with RFT plugin), added Selenium WebDriver Java libraries, got the test task completed on the same day. The test execution was far more stable and faster than RFT. Let’s face it: I was using a $11,000 per license tool as the free Eclipse Java IDE with Selenium WebDriver!
Developer-focused Testing library/tools
4. Deprecate its own and recommend Selenium WebDriver
A good example is Microsoft Coded UI Test. Microsoft deprecated Coded UI Test and recommended Selenium WebDriver in 2018. 👍
Free Open-Source Frameworks
5. Join Selenium WebDriver
Watir, Selenium, and Canoo WebTest are the three recommended test automation frameworks in the classic Agile Testing book (2009). Now, Canoo WebTest is gone (no updates since 2014). Watir becomes a syntax layer on top of the Selenium WebDriver.
While I created the slide in 2018, the hype of these JS frameworks was not around much. However, I did witness that a fake test automation engineer ruined a software project by introducing Cypress at that time.
You don’t need others to acknowledge your success in test automation (and Continuous Testing), the best judges are the ones in your company. Test automation can be assessed objectively. A simple question is “Did You Push Software Updates into Production Yesterday?”. I do it for all my web apps if there are changes made on that day. Try to assess your project against the simple and objective AgileWay Continuous Testing Grading. My estimate is that 90% of software projects are on Level 0 or 1.
If you are interested in why Cypress (and other JS automation frameworks) always fail for real test automation, read my other two articles: