I am using sharding for playwright tests with the blob reporter. Then I merge those blob reports with playwright-ctrf-json-reporter reporter and try to send the merged report, which is now ctrf compliable. But only the results call works, not the flaky one.
I am using the report merger according to the Playwright docs.
Ma11hewThomas
commented
1 month ago
Description
I am using sharding for playwright tests with the blob reporter. Then I merge those blob reports with
playwright-ctrf-json-reporterreporter and try to send the merged report, which is now ctrf compliable. But only theresultscall works, not theflakyone. I am using the report merger according to the Playwright docs.Commands
Playwright report merge:
npx playwright merge-reports --reporter playwright-ctrf-json-reporter ./all-blob-reportsSlack-ctrf send flaky tests:
SLACK_WEBHOOK_URL=WEBHOOK_URL npx slack-ctrf flaky ctrf/ctrf-report.jsonVersions
Generated ctrf report
ctrf-report.json