How to: Run Multiple Iterations of a Test Using Different Data Parameters
If you want to run a manual test case multiple times with different data, you do not have to create multiple copies of the test case. You can add parameters to the actions or expected results for any test step in your test case. Then you can add multiple sets of values for the parameters that you want to use in your test. Each set of values for the parameters is run as an individual iteration of the test using Test Runner. You can copy the value of each parameter when you run the test and then paste the value into your input field in your application under test.
This procedure describes how to run a manual test using data parameters. Before you run a manual test with data parameters, you must first create a manual test and then add data parameters to it. For more information, see How to: Create a Manual Test Case and How to: Add Parameters to a Manual Test Case To Run Multiple Times with Different Data.
For information about how to map parameters in an action recording, see How to: Map Parameters to Application Fields in an Action Recording for a Test.
- Visual Studio Ultimate, Visual Studio Premium, Visual Studio Test Professional
Load a Test with Parameters into Test Runner
To load a test that includes parameters into Test Runner
Open Microsoft Test Manager.
To display the Microsoft Test Manager window, choose Start, and then choose All Programs. Point to Microsoft Visual Studio 2012 and then choose Microsoft Test Manager.
On the center group switcher, choose the down-arrow and then choose Testing Center.
On the center group menu bar, choose Test.
In the menu under the center group menu bar, choose Run Tests if it is not already selected.
In the left pane, under Run Tests, select either the test plan or the test suite listed under the test plan that contains the test with parameters that you want to run.
The right-side pane displays the test cases within the selected test suite.
In the right-side pane, choose the test case with parameters that you want to test and then choose Run.
The Test Runner opens.
Select Run with options to specify a build to run the test on, or to override the test settings and environment settings for the test plan.
Run Multiple Iterations of Test with Parameters
To run multiple iterations of a test with parameters
In Test Runner, you are prompted to Start Test with the option to Create action recording. Leave the Create action recording check box clear and choose Start Test.
If you have configured test settings to create an action log for the test being run, selecting the Create action recording option will use the settings that you configured. If you did not configure the actions diagnostic data adapter in your test settings, then the default values are used to create your action recording. For more information, see How to: Choose the applications that are recorded in a manual test..
Notice that Test Runner includes iteration information at the top. The number of iterations will be equal to the number of parameter sets that you created when you created the test case. For more information, see How to: Add Parameters to a Manual Test Case To Run Multiple Times with Different Data.
Perform the steps of the test case for the first iteration of the test. To mark the result of a test step, choose the drop-down next to the active icon to the right of the test step and then choose either Pass or Fail.
When you come to a step that uses a parameter associated with the action, for example the Enter Quantity and Override price steps in the screen shot earlier in this document, you will see the parameter displayed as a link within the test step. You can copy the data that was assigned for the parameter by choosing its link. This copies the data into the system clipboard. You can then copy it into the appropriate input field in the application under test using CTRL+V. After the parameter data has been copied to the application under test, use the drop-down arrow to the right of the step and select either Pass or Fail.
When you come to a step that uses a parameter associated with an expected result, for example, the Choose update step in the screen shot earlier in this document, the test step will display the value that is expected for this iteration. Verify that the output field in the application under test is the same as the expected result in the test step, then use the drop-down arrow to the right of the step and select either Pass or Fail.
Choose End iteration and move to next.
The Start test dialog box is displayed.
(Optional)At the top of Test Runner, choose the drop-down arrow next to the Iteration count. All the iterations for the test case are listed and the current iteration is highlighted. You can select the next iteration to run from this list.
Repeat steps 1 through 4 until you have completed the iterations you want to test.
In the toolbar at the top of Test Runner, choose Save and Close to save your test results to Team Foundation Server and close Test Runner.