Case study of UI Test Automaton on my own migration project
Zhimin Zhan
Author | Test Automation Coach | Solopreneur l Speaker | Trainer | Freelance Blogger | International Award-winning Software Engineer | I help teams succeed with Agile/DevOps by implementing real Continuous Testing
On 29/10/20, I decided to migrate several ClinicWise features to WhenWise, my new service booking app (for direct public booking). The new features will make customers manage businesses with internal clients/sales on WhenWise as well.
With the help of Continuous Testing (execution automated UI tests regularly), I managed to complete the core work under 8 days. Most of the work were done in casual style at home (had to stop when my daughter used the study to study for exams). As usual, I spent 70+% of my development efforts on Continuous Testing (to gain 10x + productivity). The coding part was just a minor effort.
Since 2014, for every of my own project, I have pushed new builds to the production daily. Yes, the new features were added to the production every day, WhenWise customers may not realise that. This is made possible because of Continuous Testing.
The new 38 user story level UI raw selenium tests were written in TestWise. And the overall regression suite for WhenWise is 454 tests. (the first dip was removing ClinicWise sync tests which are no longer required, as WhenWise is independent now). The automated tests (not just new) detected many issues that were introduced in the migration, a large percentage of them were in the views, i.e., Microservice/API testing would not have detected them. Thanks to the quick feedback from BuildWise CT, I corrected them quickly. The 70% of the whole development effort is on maintaining all of these tests (old and new).
The total execution time of these 454 selenium tests was over 3.5 hours. By running on 6 agents in BuildWise (parallel mode): 43 mins.
The changes were big, including many database structure changes (6 new tables, plus lots of changing existing tables). And the features are product-quality (as the classic Agile: Done Done). The below is fee management of the new invoice module: with line item and overall discount.
Staff management
Appointment/Diary management
I made a new Invoicing add-on available for customers to use.
