artilleryio / artillery

The complete load testing platform. Everything you need for production-grade load tests. Serverless & distributed. Load test with Playwright. Load test HTTP APIs, GraphQL, WebSocket, and more. Use any Node.js module.
https://www.artillery.io
Mozilla Public License 2.0
8.07k stars 512 forks source link

test(cli): add assertions for not containing negative summaries #3237

Closed bernardobridge closed 5 months ago

bernardobridge commented 5 months ago

Description

We have an open issue regarding negative/null values in report (https://github.com/artilleryio/artillery/issues/2774). We haven't been able to replicate this, so we'll be adding these assertions to our test suite to see if it's able to replicate it.

It wasn't added to every test, since some use the output rather than a report for assertions. We can refactor some of the older tests that still use output, and then include this additional assertion separately.

Pre-merge checklist