search

allure-framework / allure-python

Allure integrations for Python test frameworks
https://allurereport.org/
Apache License 2.0
719 stars 235 forks source link

Add posibility to allure_robotframework listener to send "broken" test status to allure #755

Open MrBIN89 opened 1 year ago

MrBIN89 commented 1 year ago

I'm submitting a ...

What is the current behavior?

Currently allure_robotframework listener can send just four statuses to Allure - PASSED, FAILED, SKIPPED, UNKOWN (only in failure case), those are hardcoded in get_allure_status function.

What is the expected behavior?

Add possibility to send other test statuses, for example, BROKEN that actually in the default allure statuses list.

What is the motivation / use case for changing the behavior?

In my case we need to divide failed cases by different statuses on allure(failed for usual failures and broken for known cases with opened issues)

Please tell us about your environment:

allure-python-commons 2.13.2 allure-robotframework 2.13.2

delatrie commented 1 year ago

Hi, @MrBIN89

Yep, we should definitely use BROKEN for non-assertion-related errors.

Also, take a look at allure categories. That might be the feature you're looking for.