allure-framework / allure-python

Allure integrations for Python test frameworks
https://allurereport.org/
Apache License 2.0
717 stars 237 forks source link

Test Case is missing in report when It failed because of pytest worker crash #825

Open chandra0714 opened 1 month ago

chandra0714 commented 1 month ago

[//]: # ( . Note: for support questions, please use Stackoverflow or Gitter. . This repository's issues are reserved for feature requests and bug reports. . . In case of any problems with Allure Jenkins plugin please use the following repository . to create an issue: https://github.com/jenkinsci/allure-plugin/issues . . Make sure you have a clear name for your issue. The name should start with a capital . letter and no dot is required in the end of the sentence. An example of good issue names: . . - The report is broken in IE11 . - Add an ability to disable default plugins . - Support emoji in test descriptions )

I'm submitting a ...

What is the current behavior?

In my Jenkins CI, we run Selenium automation using pytest with a Selenium Grid. Sometimes, the pytest worker crashes, causing the test case to fail with the status “FAILED”. When a test case fails due to a pytest worker crash, the failed test case is missing from the report

If the current behavior is a bug, please provide the steps to reproduce and if possible a minimal demo of the problem

Python Code to reproduce the Issue:

import os

def test_simulate_crash(): if os.environ.get("PYTEST_XDIST_WORKER", None): os._exit(1) # This will crash the worker process assert True

def test_normal(): assert True

pytest-worker-crash-console-logs pytest-worker-crash-allure-report pytest-worker-crash-html-report

What is the expected behaviour?

The Failed Test Case ('test_simulate_crash' in the above code) should be shown in the allure report.

For reference, I attached the HTML report where we could see the Failed Test Cases.

What is the motivation / use case for changing the behavior?

Please tell us about your environment:

Other information

Related ticket for pytest worker crash https://github.com/pytest-dev/pytest-xdist/issues/466

[//]: # ( . e.g. detailed explanation, stacktraces, related issues, suggestions . how to fix, links for us to have more context, eg. Stackoverflow, Gitter etc )

chandra0714 commented 1 month ago

@delatrie