Allure logs all skipped steps into the report even when they do nothing since failed in previous steps

allure-framework / allure-python

Allure integrations for Python test frameworks

https://allurereport.org/

Apache License 2.0

718 stars 237 forks source link

Allure logs all skipped steps into the report even when they do nothing since failed in previous steps #678

Closed Hungleminh closed 1 year ago

Hungleminh commented 2 years ago

Problem: I'm running script using pabot and listener allure-robotframework. The problem is when the current steps failed, allure didn't stop at this step, but still log all the rest steps of current test. Can someone know any configuration of allure to stop at the failed steps and run into teardown?

Please see the attached screenshot. I got error at step 1, but the report log all the rest steps as red.

Hungleminh commented 2 years ago

I run by command: pabot --pabotlib --processes $NUMBER_OF_PROCESS --listener "allure_robotframework;$DIR_REPORT"

skhomuti commented 2 years ago

Hey @Hungleminh ! could you please provide tests (.robot files) example reproducing this problem?

Hungleminh commented 2 years ago

@skhomuti Please see the attached screenshot for robot file. also I use below command to run:

robot --listener "allure_robotframework;${ALLURE_RESULT_PATH}" ${PATH_TO_TEST}

skhomuti commented 2 years ago

Yea, I see. Seems like these steps should be 'Skipped' as earlier, not failed. It's definetely a bug and I'll fix this. Steps should be present in report like from builtin robotframework html report but they should not be failed