systelab / allure-reporter

Printable report generation for Allure
4 stars 2 forks source link

Nested result passed status all marked as fail when at least one of them is failing #61

Open atzurk opened 4 years ago

atzurk commented 4 years ago

Describe the bug If we generate the report files with an action that has several steps-results, when one of them fails that causes that all these step-results are marked as fail being passed steps.

If the step that fails is in the middle (second level, in the given example), the following steps-results are not executed nor displayed in the report.

Expected behavior Each one of the steps-results in the action should display their individual status (not all failed if that is not actually the case)

Screenshots image

ManelMoreno commented 4 years ago

Adding information: allure report represents just the expected results rows until the failure happen, the following ones are not executed and so not evaluated, not appearing in the report. This is just a visibility problem, not so relevant as the grouped steps are failed. This will affect just if I want to review the test design and not all steps appear because the design is generated form an execution and then I hide the results.

olgapuig commented 3 years ago

Limitation related to #54

olgapuig commented 3 years ago

This case can be reviewed when #68 to see if it's fixed.

ManelMoreno commented 2 years ago

This issue will not be fixed in v.3.0.0. To be evaluated in future versions.

ManelMoreno commented 11 months ago

To be evaluate if it can be fixed for v.4.0