search

microsoft / azure-load-testing

MIT License
22 stars 2 forks source link

Allow load test to continue when there is a high error rate #121

Open jmbinger opened 1 year ago

jmbinger commented 1 year ago

I have set up a load test to test throttling in my service. In this test, I am expecting a high error rate from the throttling service returning HTTP response code 429 for throttled requests. However, when I run the test, it gets cancelled by Azure Load Testing and shows the error "The test was stopped due to a high error rate. Check your script and try again. In case the issue persists, raise a ticket with support." Because of this, I am not able to see the impact of throttling on CPU resources.

Please allow for tests to continue when there are expected errors. It would also be helpful to be able to configure a test to pass when a specific error code is returned.

AB#1686776

tomkerkhove commented 1 year ago

+1

Nagarjuna-Vipparthi commented 1 year ago

@jmbinger Thank you for sharing the feedback. Currently, the tests get aborted if the error rate is >90% for a 60 sec duration. Making the auto-abort configurable is on our roadmap.