search

testomatio / app

Testomat.io is a simplified test management system for your automated tests. Issues, project board & documentation. app.testomat.io
https://app.testomat.io
27 stars 2 forks source link

Test run custom selection status possibility. add "abort" #887

Open RohalskyiOleksii opened 9 months ago

RohalskyiOleksii commented 9 months ago

Is your feature request related to a problem? Please describe.

  1. if test run is in progress but there is newer version of testing object - failing or passing run is disinformation imho.
  2. if only 1 case is failed from whole testRun it automatically counted as failed, but in reality it is possible to count it as passed if another 99% are passed, especially if fail is trivial.

Describe the solution you'd like

  1. it is better to have separate completion status "aborted".
  2. add ability to choose from statuses passed\failed\aborted
poliarush commented 9 months ago

@RohalskyiOleksii we're not going to change passed/failed/skipped statuses as it's highly integrated into different test automation frameworks, however, we're going to introduce labels for testrun. In this case, you can add a new label "aborted" and apply it to any passed/failed/skipped statuses. Also, you will have capabilities to filter by label in test report to see where tests are aborted.

related to https://github.com/testomatio/app/issues/881