webdriverio-community / wdio-html-reporter

Fork of wdio-html-format-reporter
MIT License
18 stars 27 forks source link

wdio-html-nice-reporter not working as expected when some tests are skipped in Suite. #106

Open aaggarwal-sumo opened 10 months ago

aaggarwal-sumo commented 10 months ago

Is there any known issues with running only some tests in a suite and not the whole suite for example, In a suite I have 10 test cases with it block but while running npx wdio run command i pass value of grep option as -grep @safari and it only runs 5 tests which matches with it blocks having @safari [ it('@firefox @edge @safari TestID ') ]. I see it fails with error searching for screenshot in the folder but that doesn't exists:

[0-0] For help, please check https://docs.saucelabs.com/dev/error-messages [0-0] [2023-10-15T17:27:25.029Z] [Error: ENOENT: no such file or directory, open '/Users/aaggarwal/Documents/Sumo-Repo/Aman_UI/sumo-ui-test/UIE2ETests/target/html-reports/rawSeleniumVideoGrabs/Search-Page-E2E-Test-Cases--TestID-39343211-Verify-Warning-Message-does-not-vanish-on-switching-between-search-tabs--SAFARI--10-15-2023--22-57-23-033/0000.png'] { [0-0] errno: -2, [0-0] code: 'ENOENT', [0-0] syscall: 'open', [0-0] path: '/Users/aaggarwal/Documents/Sumo-Repo/Aman_UI/sumo-ui-test/UIE2ETests/target/html-reports/rawSeleniumVideoGrabs/Search-Page-E2E-Test-Cases--TestID-39343211-Verify-Warning-Message-does-not-vanish-on-switching-between-search-tabs--SAFARI--10-15-2023--22-57-23-033/0000.png' [0-0] } [2023-10-15T17:27:25.040Z] [0-0] FAILED in safari - file:///test/specs/SearchManagement/SearchTests.ts

Here the above error it is looking for it('TestID [39343211] Verify Warning Message does not vanish on switching between search tabs', async function () {}, but it doesn't contain @safari and ideally should be skipped and reported should not look for its screenshot.

Same things were working with wdio v7 where we used "wdio-html-nice-reporter": "7.9.1", but in wdio v8 we are using "wdio-html-nice-reporter": "8.1.3-beta".