systelab / allure-reporter

Printable report generation for Allure
5 stars 2 forks source link

Nested result passed status all marked as fail when at least one of them is failing #61

Open atzurk opened 4 years ago

atzurk commented 4 years ago

Describe the bug If we generate the report files with an action that has several steps-results, when one of them fails that causes that all these step-results are marked as fail being passed steps.

If the step that fails is in the middle (second level, in the given example), the following steps-results are not executed nor displayed in the report.

Expected behavior Each one of the steps-results in the action should display their individual status (not all failed if that is not actually the case)

Screenshots image

ManelMoreno commented 4 years ago

Adding information: allure report represents just the expected results rows until the failure happen, the following ones are not executed and so not evaluated, not appearing in the report. This is just a visibility problem, not so relevant as the grouped steps are failed. This will affect just if I want to review the test design and not all steps appear because the design is generated form an execution and then I hide the results.

olgapuig commented 3 years ago

Limitation related to #54

olgapuig commented 3 years ago

This case can be reviewed when #68 to see if it's fixed.

ManelMoreno commented 2 years ago

This issue will not be fixed in v.3.0.0. To be evaluated in future versions.

ManelMoreno commented 1 year ago

To be evaluate if it can be fixed for v.4.0