question

AbramsPaulPJANC-2020 avatar image
0 Votes"
AbramsPaulPJANC-2020 asked TravisCragg-MSFT answered

How to get AzDO Build Pipeline run to fail when there are http 400-range errors in my J-Meter tests

I can run J-Meter tests in my AzDO pipelines, and I can see Http 404s and such in the .jtl I upload in my build artifact.
How can I get AzDO to report these as failures? I've made sure "Fail on standard error" is true, and "Continue on error" is false in the command for running my jmx file. I've also tried various Jmeter property settings, but nothing seems to help.
Here's the latest command I've tried:

 D:\somecrazypath\apache-jmeter-5.2.1\bin\jmeter -n -t JMETER-POC\JMETER_Sample.jmx -l results-$(Build.BuildId)\JMETER_Sample_test_results.jtl -e -o results-$(Build.BuildId)\ -Jjmeter.save.saveservice.print_field_names=true -Jjmeter.save.saveservice.response_code=true -Jjmeter.save.saveservice.response_data.on_error=true -Jjmeter.save.saveservice.assertion_results_failure_message=true -Jjmeter.save.saveservice.assertion_results=true -Jjmeter.save.saveservice.output_format=csv -Jjmeter.save.saveservice.timestamp_format=yyyy/MM/dd -Jjmeter.save.saveservice.output_format=csv
 -Jjmeter.save.saveservice.assertion_results_failure_message=true
 -Jjmeter.save.saveservice.default_delimiter=| 

Even though the resulting .jtl file has plenty of http errors, for some reason AzDO always interprets the run as a "Pass".

I need it to fail when there are failures.

azure-stack-hub
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Is it related to Azure DevOps or Azure Stack ? Please help me understand so that I can direct it to the right team. Thanks.

0 Votes 0 ·
karishmatiwari-msft avatar image
0 Votes"
karishmatiwari-msft answered

Microsoft Q&A currently do not support Azure DevOps.

The Azure DevOps team and community are active and answering questions on : https://developercommunity.visualstudio.com/spaces/21/index.html

Please post your question there and the experts will help you there.

You can also post your question here: https://stackoverflow.com/questions/tagged/azure-devops. Thanks

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

TravisCragg-MSFT avatar image
0 Votes"
TravisCragg-MSFT answered

Azure DevOps is not supported on Microsoft Q&A. The best place to ask these questions are on Stack Overflow under the azure-devops tag.


5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.