search

webdriverio-community / wdio-vscode-service

A service to test VSCode extensions from end to end using WebdriverIO
https://webdriverio-community.github.io/wdio-vscode-service/
MIT License
29 stars 23 forks source link

Flaky CI Test on Mac #112

Open seanpoulter opened 5 months ago

seanpoulter commented 5 months ago

The following test has been intermittently failing all 3 retries in the CI pipeline:

[chrome 118.0.5993.159 mac #0-5] Running: chrome (v118.0.5993.159) on mac
[chrome 118.0.5993.159 mac #0-5] Session ID: b4d99761df66b404c2f0163c1d381691
[chrome 118.0.5993.159 mac #0-5]
[chrome 118.0.5993.159 mac #0-5] » /test/specs/settings.e2e.ts
[chrome 118.0.5993.159 mac #0-5] settings @skipWeb
[chrome 118.0.5993.159 mac #0-5]    ✖ openSettings
[chrome 118.0.5993.159 mac #0-5]
[chrome 118.0.5993.159 mac #0-5] 1 failing (24.2s)
[chrome 118.0.5993.159 mac #0-5]
[chrome 118.0.5993.159 mac #0-5] 1) settings @skipWeb openSettings
[chrome 118.0.5993.159 mac #0-5] Timeout
[chrome 118.0.5993.159 mac #0-5] Error: Timeout
[chrome 118.0.5993.159 mac #0-5]     at listOnTimeout (node:internal/timers:569:17)
[chrome 118.0.5993.159 mac #0-5]     at processTimers (node:internal/timers:512:7)

For example, this affected #111 (first run).

seanpoulter commented 5 months ago

It also affects stable. See the first run in #116.