search

qase-tms / qase-javascript

Qase TMS JavaScript SDK
https://developers.qase.io
49 stars 43 forks source link

Does playwright-qase-reporter support different reports for different browsers? #527

Closed saysetel closed 6 months ago

saysetel commented 6 months ago

Good day. Thank you for playwright-qase-reporter, love to use this! I'm curious, is there any way to generate separate test runs for each browser? I run tests on chromium and WebKit. For now, when I use "QASE_REPORT=1 yarn playwright test" it generates one test run in Qase, where each test case has a "retest" status for each browser.

image

Would be great if there option to create two separate runs, for chromium and for WebKit, for example, instead of one.

NickVolynkin commented 6 months ago

Hey, @saysetel!

The easiest way to achieve this is to run Playwright multiple times, with a different browser each time:

QASE_REPORT=1 yarn playwright test --browser chrome
QASE_REPORT=1 yarn playwright test --browser firefox

See https://playwright.dev/docs/test-cli#reference for the reference. This way, you will get multiple test runs in Qase, one for each browser.

However, there could be an option to report tests to a single run, not as retests, but as parameterized variants of a single case. The qase-playwright reporter doesn't support this option currently, but we can implement it.

saysetel commented 6 months ago

Got it, thank you very much for the information!