Add, run, and update inline tests

VSTS | TFS 2018 | TFS 2017

Similar to task checklists, you can quickly define inline tests, or a set of manual tests, for a backlog item from your Kanban board. Not only can you add tests, you can run them and update their status. If you're new to working with the Kanban board, see Kanban basics.

In this topic, you'll learn:

  • How to add inline tests to a backlog item from your Kanban board
  • How to run tests and update the status of tests
  • How to expand or collapse inline tests
  • How to reorder or reparent inline tests

Web portal, Kanban board with several inline tests defined

Tests you create from the Kanban board are automatically linked to the user story or backlog item.

Prerequisites

  • You must connect to a project. If you don't have a project yet, create one in VSTS.
  • You must be a member of the Contributors group or be granted Stakeholder access to add or modify work items. Or, you must have your View work items in this node, and your Edit work items in this node permissions set to Allow.
  • If you haven't been added to a project or team, get added now.

To learn more, see Set permissions and access for work tracking.

  • You must connect to a project. If you don't have a project yet, create one in an on-premises TFS.
  • You must be a member of the Contributors group or be granted Stakeholder access to add or modify work items. Or, you must have your View work items in this node, and your Edit work items in this node permissions set to Allow.
  • If you haven't been added to a project or team, get added now.

To learn more, see Set permissions and access for work tracking.

Open your Kanban board from the web portal

Note

Choose Previous navigation when you see a top-level blue bar. Choose New navigation if you see a vertical sidebar or if you enabled the New Navigation preview feature. The vertical sidebar, along with other navigational features, is enabled when the New Navigation preview feature has been enabled for the signed-in user or the VSTS organization. To learn how to use the web portal effectively, see Navigation Basics.

For on-premises TFS users, choose Previous Navigation for guidance.

  1. To view your Kanban board, open your project from a web browser and choose (1) Work, (2) Boards, and then (3) select the team's board from the selector.

    Open your Kanban board

    To choose another team's board, open the selector and select a different team or choose the home-icon Browse all team boards option. Or, you can enter a keyword in the search box to filter the list of team backlogs for the project.

    Choose another team's board

    Tip

    Choose the star icon to favorite a team board. Favorited artifacts ( favorited icon) appear at the top of the team selector list.

New navigation isn't supported on TFS at this time. Choose Previous navigation for guidance.

Add tests

  1. To start adding tests, open the menu for the work item.

    Open the context menu of a backlog item to add inline test case

    Adding inline tests is the same as adding test cases to a test suite. A default test plan and test suite are automatically created under which the manual test cases are grouped.

    For example, a test suite is created for each user story, and all inline tests are added to that suite. Below, user story 152 is highlighted which has three manual tests defined with IDs of 153, 155, and 161.

    Inline test cases get added to test suites and test plans

    To learn more about test plans and test suites, see Plan your tests.

  2. If you have a number of tests to add, simply keep typing each title and click Enter.

    Work item with several test cases added

    To add details to the test case, open it. You can click the title, double-click the inline item, or open the context menu and choose Open.

    Open test case form from Kanban board

See Create manual tests to learn more about defining tests.

Prior to running the test, you must add details.

Run test

Run the test by selecting Run icon Run test from the Actions icon actions menu for the inline test.

Run a test

Microsoft Test Runner starts in a new browser instance. For details on running a test, see Run manual tests.

Update the status of a test

You can update the status of the test from the Actions icon actions menu .

Check tasks that are complete

Updating the status of tests enable you to track test results.

Why doesn't the Kanban board show the status for test suites and plans already created in Test?

Expand or collapse inline tests

Upon first opening the Kanban board, you'll see an unexpanded view of checklists.

Inline tests collapsed

Simply click the inline test summary to expand a collapsed set of tests. Click the same summary to collapse an expanded list.

Inline tests expanded

Copy or reparent a test

To reparent a test, drag and drop the test onto a different user story.

Drag tests to reassign them to a different user story

This action automatically changes the linked relationship of the test to point to the new user story.

To create a copy of a test to add to a different user story, select the test, press the CTRL key and then drag and drop the test onto the card of the user story.

Use inline tests for lightweight traceability and to manage manual tests for user stories or other backlog items that they support. To learn more about test case management, see Create manual tests.

If you find that you don't use this feature, you can disable it from the common configurations dialog.

Additional ways you can quickly add linked items and objects to user stories from the Kanban board:

To initate web-based exploratory testing for a user story, you need to install the Exploratory testing , see Exploratory test your web app directly in your browser.

Test status in the Kanban board

Test integration with the Kanban board makes it easy for teams to get started with manual testing and then take advantage of the full testing capabilities in Test Manager later, when required. When test cases are created from the Kanban board and updated afterwards in Test Manager, the Kanban board shows the correct status. However, integration is not optimized to work in the other direction; for example, when users create requirement-based suites with Test Manager instead of in the Kanban board. We intend to make some major performance improvements to this integration in future releases.