Tests all failed but success rates shows 100%

Zooz / predator

A powerful open-source platform for load testing APIs.

https://zooz.github.io/predator/

Apache License 2.0

570 stars 108 forks source link

Tests all failed but success rates shows 100% #564

Closed zhchen-zhchen closed 3 years ago

zhchen-zhchen commented 3 years ago

report detail page shows all tests failed, but the report list pages show 100% success rates shows

NivLipetz commented 3 years ago

this happens because the expectations failed, but all of the requests succeeded. We don't associate the expectations success (assertions on the responses) and the test run success (whether got an OK response from server)

zhchen-zhchen commented 3 years ago

I understand. Thanks