Create test plans and test suites

Azure DevOps Services | Azure DevOps Server 2022 - Azure DevOps Server 2019 | TFS 2018

Create test plans and test suites to track manual testing for sprints or milestones. That way, you can see when the testing for a specific sprint or milestone is complete. For more information about manual testing, see What is Azure Test Plans?.

Share work items across your test experience

For example, you're building version 1.* of your product and you might create several test cases for that version. Each of these test cases can be updated, and more added, at any time. For each development cycle and release of your product, you create a test plan and import the existing test cases into that plan. You can also, if you wish, divide the test cases into separate test suites within the plan to enable easier management and monitoring of these separate sets of test cases.

After you create your test plan, you assign test configurations and assign testers to cover the required test matrix. These testers run the tests and gauge the quality of the product. Testers continue testing until the product meets exit criteria. For the next development cycle and release, you can create a new test plan and reuse the same test cases. Repeat this development-test-release cycle by importing the same test cases into each new test plan.

Because test plans refer to test cases, updates to a test case automatically reflect in all the test plans and test suites that use it.

In the next version of the product, you can reuse the existing test cases. However, a better option might be to copy or clone the test cases. A copy creates a new baseline. Changes to these new test cases don't affect your previous test plans.

Tip

For more information about the ways you can work with test plans, test suites, and test cases, see the FAQs for manual testing.

Prerequisites

You must have the following permissions and access levels:

  • Basic access or higher and permissions to view work items under the corresponding Area Path. For more information, see Add users to a project or team.
  • Basic + Test Plans access level to add test plans and test suites, delete test artifacts, and define test configurations. Or, have one of the following Visual Studio subscriptions:
  • You must have the following permissions:to add or edit test-related artifacts,
    • Edit work items in this node permission set to Allow under the corresponding Area Path, to add or modify test plans, test suites, test cases, or other test-based work item types.
    • Manage test plans permission set to Allow under the corresponding Area Path, to modify test plan properties such as build and test settings,.
    • Manage test suites permission set to Allow under the corresponding Area Path, to create and delete test suites, add, and remove test cases from test suites, change test configurations associated with test suites, and modify a test suite hierarchy (move a test suite).

For more information, see Manual test access and permissions.

Note

If you're new to using Azure Test Plans, review Navigate Test Plans to understand how to use the user interface to access select functions.

If a user with Basic access can perform the same functionality as a Basic + Test plans license user, uninstall the extension Test manager for TFS 2017 and TFS 2018 from the organization, as this extension is deprecated and has been removed from the marketplace.

Create a test plan

In general, you create test plans to test requirements. Before you create a test plan, define your backlog of requirements.

  1. Sign in to your Azure DevOps project and select Test Plans > Test Plans.

    Screenshot of opening the list of test plans page for Azure DevOps Server 2020 and Azure DevOps Services.

  2. Select + New Test Plan.

    Screenshot of creating a new test plan for Azure DevOps Server 2020 and Azure DevOps Services.

  3. Enter a name for the test plan, verify that the area path and iteration are set correctly, and then select Create.

    Screenshot of adding test plan details for Azure DevOps Server 2020 and Azure DevOps Services.

Rename a test plan

To rename a test plan, do the following steps.

  1. Select Test Plans.

  2. Next to the test plan name, select More Actions > Edit.

    Screenshot shows option to edit a test plan.

  3. Change the name and then select Save & Close.

You can make other changes to the test plan here.

Delete a test plan

To delete a test plan, do the following steps.

  1. Select Test Plans.

  2. Next to the test plan name, select More Actions > Delete.

  3. The Permanently delete test artifacts dialog box explains exactly what gets deleted. Enter the test plan ID to confirm that you want to delete, and then select Permanently delete.

    Screenshot shows permanently delete test artifacts dialog box.

In general, you create test plans to test requirements. Before you create a test plan, define your backlog of requirements.

  1. From the web portal, open your project and go to Test Plans. If you already have a test plan, select Test Plans to go to the page that lists all test plans.

    Screenshot showing opening the list of test plans page.

  2. Select New Test Plan.

    Screenshot showing creating a new test plan.

  3. Enter a name for the test plan, verify that the area path and iteration are set correctly, and then select Create.

    Screenshot showing adding test plan details.

Rename a test plan

To rename a test plan, open it from the shortcut menu and rename it.

Screenshot showing renaming a test plan.

Delete a test plan

To delete a test plan, use the shortcut menu for the test plan.

Screenshot showing delete a test plan.

Add a requirement-based test suite

Now add test suites for the backlog items that need manual tests. These tests could be user stories, requirements, or other work items based your project.

Note

Requirement tracking is supported only for test cases linked through a Requirement-based test suite. Work items include a User Story (Agile), Product Backlog Item (Scrum), Requirement (CMMI), and Issue (Basic). The association between a requirement work item and manual test execution is only formed when the test case is linked by using a Requirement-based test suite.

  1. To add a suite to a test plan, select More options for the test suite, and then select New Suite > Requirement based suite.

    Screenshot shows creating a requirement-based test suite for Azure DevOps Server 2020 and Azure DevOps Services.

    You use requirement-based suites to group your test cases together. That way, you can track the testing status of a backlog item. Each test case that you add to a requirement-based test suite is automatically linked to the backlog item.

  2. In Create requirement-based suites, add one or more clauses to filter your work items by the iteration path for the sprint. Run the query to view the matching backlog items.

    Screenshot shows adding clauses to filter by iteration and running the query to view results for Azure DevOps Server 2020 and Azure DevOps Services.

  3. In the list of work items returned by the query, select the backlog items you want to test in this sprint. Select Create suites to create a requirement-based suite for each one.

    Screenshot shows adding requirement-based suites for your backlog items for Azure DevOps Server 2020 and Azure DevOps Services.

Now add test suites for the backlog items that need manual tests. These tests could be user stories, requirements, or other work items based your project.

Note

Requirement tracking is supported only for test cases linked through a Requirement-based test suite. The association between a requirement work item—User Story (Agile), Product Backlog Item (Scrum), Requirement (CMMI), or Issue (Basic) and manual test execution is only formed when the test case is linked via a Requirement-based test suite.

  1. To add a suite to a test plan, select + new drop-down list and choose a type of test suite.

    Screenshot showing creating a requirement-based test suite.

    Use requirement-based suites to group your test cases together, so you can track the testing status of a backlog item. Each test case that you add to a requirement-based test suite is automatically linked to the backlog item.

  2. In Create requirement-based suites, add one or more clauses to filter your work items by the iteration path for the sprint. Run the query to view the matching backlog items.

    Screenshot showing adding clauses to filter by iteration and running the query to view results.

  3. In the list of work items returned by the query, select the backlog items you want to test in this sprint. Choose Create suites to create a requirement-based suite for each one.

    Screenshot showing adding requirement-based suites for your backlog items.

Work with test suites

You can create a static test suite that can contain any type of test suites. Use these test suites like folders. Drag test suites to group them in a static test plan. Drag and drop tests to reorder them.

Screenshot shows using drag and drop to move a test.

Screenshot shows using drag and drop to reorder tests.

You can track changes to test plans and test suites. Open the work item for the test plan or test suite, then view the work item history.

For test suites, other actions are tracked in the Test Suite Audit field. For example, adding and removing test cases from a test suite are tracked in this field.

Export test plans, test suites, and test cases.

Select Export test cases to CSV.

Screenshot shows a test plan selected and the Export test cases to CSV option.

Select the details that you want in the report. Then email or print this report for review.

Screenshot showing right-clicked test suite, and Export button.

Change the test case fields in the report by adding or removing columns from the list view of the test suite.

Important

You can't' export more than 75 Test Suites in a single operation. The email supports up to 1MB of data.

Find a test case in a test plan

In Test Plans for your test plan, use the filter icon to show the search and filter list. It can help find the tests you want.

Screenshot shows finding a test plan for Azure DevOps Server 2020 and Azure DevOps Services.

In Test Plans for your test plan, use the filter icon (1) to show the search and filter lists (2) that help you find the tests you want to work with. Or filter the list of tests using Outcome, Tester, and Configuration (3).

Screenshot showing Finding a test plan.

Next steps