allure-framework / allure-python

Allure integrations for Python test frameworks
https://allurereport.org/
Apache License 2.0
713 stars 233 forks source link

If the step combines strong and soft checks, then the step is marked as pass despite soft checks failed #781

Open esultanza opened 7 months ago

esultanza commented 7 months ago

I'm submitting

If the current behavior is a bug, please provide the steps to reproduce and if possible a minimal demo of the problem

  1. Run test
    
    @allure.id("6088")
    def test_draft():
    with allure.step("Проверка, что cevvсуммы равны"):
        assert 2+2==1+3
        for digit in [1,2,3]:
            with check: assert digit == 10

2. Check status for steps at *-result.json in allure-results

#### What is the expected behavior?
The step marked as failed

#### What is the motivation / use case for changing the behavior?
Correct mark

#### Please tell us about your environment:

- pytest-check:           2.2.1
- Test framework:       pytest@7.4.1
- Allure adaptor:        allure-pytest@2.13.2

#### Other information 
[18285403-d1b5-4ce8-bad2-3e81e4f78bb4-result.json](https://github.com/allure-framework/allure-python/files/13651296/18285403-d1b5-4ce8-bad2-3e81e4f78bb4-result.json)
Faerie1999 commented 4 days ago

Hello,I met the problem as above, has the bug fixed?