Run manual tests
Azure Test Plans | Azure DevOps Server 2020 | Azure DevOps Server 2019 | TFS 2015-2018
Run your manual tests and record the test results for each test step using Microsoft Test Runner. If you find an issue when testing, use Test Runner to create a bug. Test steps, screenshots, and comments are automatically included in the bug. You can use the web runner for web apps, or the desktop runner for desktop app data collection.
To use all the features described in this article, you must have one of the following subscriptions:
Or, configure Basic + Test Plans access level.
Run tests for web apps
If you haven't already, create your manual tests.
Select a test from a test suite and run it.
Microsoft Test Runner opens and runs in a new browser.
Start the app that you want to test. Your app doesn't have to run on the same computer as Test Runner. You just use Test Runner to record which test steps pass or fail while you manually run a test. For example, you might run Test Runner on a desktop computer and run your Windows 8 store app that you are testing on a Windows 8 tablet.
Mark each test step as either passed or failed based on the expected results. If a test step fails, you can enter a comment on why it failed or collect diagnostic data for the test.
Any test step that has expected result is called a validation test step. Testers must mark a test step with a status if it is a validation test step. The overall result for a test case reflects the status of all the test steps that the tester marked. Therefore, the test case will have a status of failed if the tester marked any test step as failed or not marked.
Create a bug to describe what failed.
The steps and your comments are automatically added to the bug. Also, the test case is linked to the bug.
If Test Runner is running in a web browser window, you can copy a screenshot from the clipboard directly into the bug.
You can see any bugs that you have reported during your test session.
When you've run all your tests, save the results and close Test Runner. All the test results are stored in Azure DevOps. How do I resume testing, or run one or more tests again?
View the testing status for your test suite. You see the most recent results for each test.
Open a test and choose the test case in the Related Work section. Then use the Child links in the Related Work section of that work item to view the bugs filed by the tester.
Run tests for desktop apps
If you want to collect more diagnostic data for your desktop application, run your tests using Test Runner client:
Launch the test runner client from Azure Test Plans in Azure DevOps by choosing Run for desktop application from the Run menu.
Download and install the Test Runner desktop client if you haven't already set it up:
Check that the Test Runner client is available for your platform. Currently, the Test Runner client is available only for x64.