Request: Add simple way to set failure and latency thresholds in the config.json

[ctissellb]

It would be quite handy to be able to use the config to set global or per scenario latency and failure percent thresholds rather than MaxFailCount.

For instance:

MaxFailPercent: 10 <-- Scenario failure rate must not exceed 10% MaxHighLatencyPercent: [10, 500] <-- The number of scenarios that take longer than 500ms to complete must not exceed 10%

[AntyaDev]

This is actually a very good suggestion. I will add it to the next release v5.8.0

[AntyaDev]

Hi @ctissellb What do you think about this API:

"GlobalSettings": {

        "ScenariosSettings": [
            {
                "ScenarioName": "scenario",

                "ThresholdSettings": [
                    { "StepName":  "global-info", "StatusCode": ["200", "Count => 20"] },

                    { "StepName":  "login", "Errors": "Percent > 20" },

                    { "StepName":  "logout", "Latency": "P50 >= 30" },

                    { "StepName":  "logout", "Latency": "Max >= 900" },

                    { "StepName":  "logout", "Request": "RPS >= 900" }                    
                ]
            }
        ]
}

• It should support GlobalSettings
• It should be displayed on HTML report
• It should support "StartMeasure from specific time"
• It should support AbortScenario after failure count

[ctissellb]

Works for me!