search

testomatio / app

Testomat.io is a simplified test management system for your automated tests. Issues, project board & documentation. app.testomat.io
https://app.testomat.io
27 stars 2 forks source link

Runs: Preserve original order of scenarios in test result #947

Open mirao opened 7 months ago

mirao commented 7 months ago

Is your feature request related to a problem? Please describe. Our test suite contains scenarios in this order (taken from VSCode)

image

Describe the solution you'd like When the test finishes, and I look into "Runs", I would like to have the order of the scenarios the same as original one. It's because our scenarios depend on each other, so we need to keep their ordering. This way it works in https://codecept.io/reports/#html that we are currently using.

But in Testomat, I'm getting a "random" order (sometimes less, sometimes more "random"): E.g. these scenarios should be swapped. image

Used SW:

mirao commented 7 months ago

Another example:

Report URL: https://app.testomat.io/projects/spork/runs/4c0e9ca2/report

Original order: image

Testomat's order image

mirao commented 7 months ago

It seems that it works well here: https://app.testomat.io/projects/spork/runs/4c0e9ca2/report/ image but doesn't work here: https://app.testomat.io/projects/spork/runs/4c0e9ca2 image

So it's rather a bug than a suggestion.