Is your feature request related to a problem? Please describe.
Test status for test in TestRail is pass, when parametrized test fails for some parameteres, but the last test param was successful.
I have found that sorting by status_id was removed due to another request where rerun-failures was used, and in that case desired sequence of test cases was different.
Describe the solution you'd like
I would love to have an ability to turn sorting by status_id on, so that if at least one param in parametrized test fails, the whole test is marked as fail in TestRail.
Describe alternatives you've considered
I've googled if it is possible to change behaviour of TestRail, but it seems, that currently TestRail decides what is the final test status based on the last test result it receives. And there is no way to change behaviour on TestRail side.
Additional context
I'll make a PR that keeps current behaviour, but adds an option to sort by status_id
neanton
commented
3 years ago
Is your feature request related to a problem? Please describe. Test status for test in TestRail is pass, when parametrized test fails for some parameteres, but the last test param was successful. I have found that sorting by status_id was removed due to another request where rerun-failures was used, and in that case desired sequence of test cases was different.
Describe the solution you'd like I would love to have an ability to turn sorting by status_id on, so that if at least one param in parametrized test fails, the whole test is marked as fail in TestRail.
Describe alternatives you've considered I've googled if it is possible to change behaviour of TestRail, but it seems, that currently TestRail decides what is the final test status based on the last test result it receives. And there is no way to change behaviour on TestRail side.
Additional context I'll make a PR that keeps current behaviour, but adds an option to sort by status_id