grafana / k6-cloud-feature-requests

The place to propose, dicuss and vote for k6 Cloud features and ideas.
9 stars 1 forks source link

Add performance insight alert about too many skipped iterations #62

Closed MattDodsonEnglish closed 9 months ago

MattDodsonEnglish commented 1 year ago

In the open-model scenarios, k6 provisions VUs to send them at the specified rate.

If the SUT performance completely tanks, k6 at some point will not be able to provision more VUs and will record that an iteration has been ommited. So, many omitted iterations could indicate a test failure. (Paraphrasing @sniku's explanation here; any errors introduced are my own).

"Too many skipped iterations" could be a valuable performance insight. What's more, just having an alert about it could help inform users about the coordinated omission problem.