Azure Testplan - Drive a collaborated quality management process

Azure Test Plans provide browser-based test management solution for exploratory, planned manual, user acceptance testing and stakeholder feedback. Also, it is fully integrated with Azure Pipelines to support automated testing associated with build/ release pipelines. Test cases and test suites linked to work items support end-to-end traceability where user can run tests from the Kanban board. Test result tracking and progress monitoring is supported through configurable tracking charts, test-specific widgets which can be added to dashboards.

Benefits of Azure Test Plans for software development teams:

• Test on any platform
• Rich diagnostic data collection
• End to End traceability
• Integrated analytics
• Extensible platform

Let's look into step-by-step process on test plans and test suite based on requirement. This will be based on ERP implementation process from my previous article where the test suite is created based on user story.

1. Navigate to Test Plan -> New Test Plan

2. Enter Name -> Select Area Path & Iteration -> Create

3. Create Requirement-based test suite

4. Select the query filters -> Run Query -> Select work item -> create suite

Define new Test case

5. Test suite will be created. Add new test case on Define tab.

6. Enter title -> Enter step and expected result -> Save & Close

Define test case on Grid View

6.1. On Define tab -> Click on Grid View icon

6.2 Enter Title, Steps & Expected Result in Grid View -> Save

Execute Test cases - Manual tests using web based test runner

7. On Execute tab, select the test cases -> Click Run with options -> Select manual web based test runner type -> run

8. Test runner opens with the selected test cases & steps

9. Mark the test results (Pass / Fail) on steps -> Save

10. If a step is failed, comment and create bug from the test runner

10.1. Bug work item will be opened with tested steps -> Enter Title -> Save

11. On Execute tab, execution outcome is displayed.

Progress Report

Progress report shows test suite wise outcome trend, summary and details in one screen that helps to track the team's progress with respect to planned testing of the product or service.

1. Summary: This section provides you with a consolidated view for the selected test plans.
2. Outcome trend: This graph renders a daily snapshot to give you an execution and status trendline. It can show data for 14 days (default), 30 days, or a custom range of your choice. Data for today may or may not appear in this chart based on the time of the day you are looking at the report.
3. Details: This section lets you drill down by each test plan and gives you summary of each test suite in it. The section also lets you navigate to a test plan or suite of choice by double-clicking on it.

This article had given test plan definition and execution process for a requirement which can be used on a simple development cycle. Other components of Azure Test Plan will be discussed in the upcoming articles.

Thank You!