search

microsoft / azure-load-testing

MIT License
22 stars 2 forks source link

[BUG] Azure pipeline task not reporting failures to the pipeline #133

Closed brunogoettmann closed 1 year ago

brunogoettmann commented 1 year ago

Describe the bug Azure DevOps task for Azure Load Testing is no longer reporting failures on the test nor there doesn't seem to have a similar configuration option to fail the task when the test fails.

To Reproduce Steps to reproduce the behavior:

  1. Install v1.2.18 of Azure Load Testing from here
  2. Create a jMeter test case that reports error
  3. Create a pipeline with a AzureLoadTest@1 task
  4. Set percentage(error) > 0 as failure criteria
  5. Run the pipeline
version: v0.1
testId: my-test
description: My test description
engineInstances: 1
testPlan: test-example.jmx
failureCriteria:
- percentage(error) > 0

Expected behavior The pipeline task fails if the there's any test failures

Additional context It seems to be a regression from v1.2.17 to v1.2.18.

AB#1719418

brunogoettmann commented 1 year ago

It has now been fixed in v1.2.19 released on Jan 16, 2023.

Thanks!