Dynamic Test Suite Creation and Execution in Efficient Manner : Katalon Execution Load Balancing Solution

Problem Statement:?

• Utilizing available nodes fully?
• Generating test suite dynamically based on tags?
• Running pipeline which will execute regression end to end based on test suite collection available?

Proposed solution:?

?

Components Used:?

Dynamic Test Suite generation:?

• Operation between multiple tags works as "and"?
• Test cases added with same tags after creating a test suite will picked up automatically at run time (even if those are not there in the preview of the test suite after you build the query)?
• We cannot put multiple conditions within a same query from a query builder e.g. searching tests based on tags and name (this is katalon limitation)?
• Execution goes the same way normal test suite is getting executed?
• As per documentation query applies to all the element in the katalon but couldnt see test suite collection is searched even if the tags are matching?

https://docs.katalon.com/docs/legacy/katalon-recorder/get-your-job-done/execute-scenarios/dynamic-test-suite?

https://docs.katalon.com/docs/organize/manage-tests/dynamic-test-suite/manage-dynamic-test-suites-in-katalon-studio?

https://docs.katalon.com/docs/organize/manage-tests/dynamic-test-suite/test-case-management-with-tags?

https://docs.katalon.com/docs/legacy/katalon-studio-enterprise/create-tests-and-projects/manage-projects/search-test-cases?

?

Jenkins:?

Dynamic job creation using DSL plugin based on a test suite collection?

https://medium.com/slalom-build/automatically-generating-jenkins-jobs-d30d4b0a2b49?

?

Advantages:?

• End to end solution which caters all the problem areas?
• Configuration is easy and can be done quickly?
• Integration with katalon engine is not an issue?

Challenges or To-Do:?

• Need to see if the DSL plug in is okay to use?
• See if above solution has any major drawbacks?
• Tags must be updated in all the test cases and going forward we need to add tags to all the test cases being implemented?