search

testomatio / reporter

Testomatio Reporter
115 stars 18 forks source link

Cucumber WDIO reporter - Scenario Outline results merged in 1 single execution result in testomat #350

Open Automata3D opened 1 month ago

Automata3D commented 1 month ago

Describe the bug When running "Scenario Outline" examples with Cucumber+WebdriverIO (Appium service), the test run in testomat seems to just upload the latest example result.

To Reproduce Steps to reproduce the behavior:

  1. Create a "Scenario Outline" with several examples using Cucumber+WebdriverIO framework.
  2. Run the test adding the needed config in order to create the test run report in testomat "npx start-test-run -c 'dotenv -e .env -- npx wdio config/local/ios.conf.js --parallel=true' --env-file .env"
  3. Note we are using wdio-cucumber-parallel-execution, which creates 1 webdriverio session per Cucumber example
  4. Once the run is finished, in testomat we just get the latest example execution as the feature result

Expected behavior Ideally, we should have a result per each scenario outline example, meaning that probably scenario outlines should be treated as test suites containing different tests.

Screenshots If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

Smartphone (please complete the following information):

TetianaKhomenko commented 1 week ago

Hi @Automata3D! Could you please if the issue reproduces if you don't use https://github.com/SimitTomar/wdio-cucumber-parallel-execution ?