jenkinsci / allure-plugin

Allure Jenkins Plugin
https://plugins.jenkins.io/allure-jenkins-plugin/
Other
84 stars 63 forks source link

Change status of the build depending on a threshold #277

Open arturmkr opened 3 years ago

arturmkr commented 3 years ago

Allure Jenkins plugin changes status of the Jenkins build to FAILED, if at least one test is failed. It would be great if Allure changes status of the Jenkins build depending on threshold (how many tests are OK to be failed).

For example, if threshold is 10 and 5 tests are failed - status is SUCCESS. If threshold is 10 and 20 tests are failed - status is FAILED.

@baev , could you please help.

tyborg commented 3 years ago

I have the same problem. Some of our tests are unstable now, and I only want to set the stage to UNSTABLE but the build to SUCCESS. This is working well till that point when I integrated the plugin to the pipeline and now the build is FAILED.

image