search

allankp / pytest-testrail

pytest plugin for integration with TestRail, for creating testruns and updating results
MIT License
95 stars 125 forks source link

Publishing successful flaky/rerun results only #100

Closed eparubrub-view closed 4 years ago

eparubrub-view commented 5 years ago

Currently, I have a couple test cases that are flaky and use the mark "@pytest.mark.flaky" in order to rerun the test cases that fail once in a while. After the rerun, some test cases will pass (meaning the case failed first and passed on the rerun), but the current functionality of pytest-testrail will publish the failed run on top (meaning the test case will be marked as failed as a whole). Is there a way to publish the passed run first or a way to only published the passed run? If not, I would like to request a feature for this. Overall, I would like to publish the test case as passed if one of the reruns succeeds.

allankp commented 4 years ago

This has been resolved in : https://github.com/allankp/pytest-testrail/pull/108

wswiatkowski commented 2 years ago

Hi! I'm using pytest-rerunfailures plugin in my test suite. Issue mentioned in this topic is still occurring in my test suite, so I have a FAILED status on tests which are rerunned - even if they PASSED in the second try. Could you address this issue?