search

pytest-dev / pytest-bdd

BDD library for the pytest runner
https://pytest-bdd.readthedocs.io/en/latest/
MIT License
1.32k stars 221 forks source link

Cucumber JSON report is generated without skipped tests info #567

Open waad19 opened 2 years ago

waad19 commented 2 years ago

Environment: platform darwin -- Python 3.9.12, pytest-7.1.2, pluggy-1.0.0 plugins: splinter-3.3.2, bdd-6.0.1, clarity-1.0.1

Steps to reproduce:

  1. Create simple pytest-bdd setup with feature file and tests.
  2. In feature file and default @skip flag like this: @skip Scenario: Test1 When blabla Then blablabla Or any other way to skip test execution
  3. Run pytest with addopts = -vv -rsfx --cucumber-json=cucumber_report.json --gherkin-terminal-reporter --color=yes in pytest.ini or same alternative in CLI
  4. Gherkin terminal output will contain test_bla.py::test_bla <- venv/lib/python3.9/site-packages/pytest_bdd/scenario.py SKIPPED (unconditional skip)

Actual result:

  1. cucumber.json file doesn't contain any info about skipped test at all

Expected result:

  1. cucumber.json file contains info about skipped test (at least ..."result": {"status": "skipped"... )
janluak commented 1 month ago

Hi @waad19,

it seems it took a while - I just opened a PR which fixes at least if skipping a scenario. If the full feature is skipped it's not covered by my fix. Yet, hope to deliver that sometime soon as well ;)

Best, janluak