GUI E2E tests transient failures

[farmaazon]

Gathered from various failed CI jobs:

• [x] page.evaluate: TypeError: window.mockExpressionUpdate is not a function: https://github.com/enso-org/enso/actions/runs/7751892939/job/21140491920#step:8:467 and many more
• [x] componentBrowser.spec.ts:10:1: Error: Timed out 5000ms waiting for expect(locator).toBeVisible(): https://github.com/enso-org/enso/actions/runs/7741528277/job/21108714847#step:8:465 - addressed in #8909
• [x] collapsingAndEntering.spec.ts:59:1: Error: locator.dblclick: Test ended. https://github.com/enso-org/enso/actions/runs/7740219181/job/21104723075#step:10:550
• [x] labels.spec.ts:34:6 › drag labels onto multiple rows: Error: Timed out 5000ms waiting for expect(locator).toBeVisible(): https://github.com/enso-org/enso/actions/runs/7744082603/job/21117011619?pr=8902#step:8:472
• [x] Bindings not found https://github.com/enso-org/enso/actions/runs/7842841953/job/21402194728?pr=9013#step:8:458
• [x] collapsingAndEntering.spec.ts:37:1 › Using breadcrumbs to navigate: Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected) https://github.com/enso-org/enso/actions/runs/7916832238/job/21611541700#step:8:475
• [x] collapsingAndEntering.spec.ts:59:1 › Collapsing nodes: Error: locator.dblclick: Test timeout of 30000ms exceeded. https://github.com/enso-org/enso/actions/runs/7971892170/job/21762515753#step:8:481
• [x] fullscreenVisualisation.spec.ts:18:1 › Load Fullscreen Visualisation: Error: page.waitForTimeout: Test timeout of 30000ms exceeded. https://github.com/enso-org/enso/actions/runs/7990458678/job/21819326876#step:8:481
• [x] collapsingAndEntering.spec.ts:26:1 › Leaving entered nodes: Test finished within timeout of 30000ms, but tearing down "context" ran out of time. https://github.com/enso-org/enso/actions/runs/8023372271/job/21919713031#step:8:482
• [x] componentBrowser.spec.ts:124:1 › Filling input with suggestions: Error: expect(locator).toBeVisible() https://github.com/enso-org/enso/actions/runs/8084013760/job/22088345557?pr=9075#step:8:671
• [x] src/composables/__tests__/selection.test.ts → Cannot set property currentTarget of #<Event> which has only a getter https://github.com/enso-org/enso/actions/runs/8102076908/job/22143749078?pr=9229
• [x] componentBrowser.spec.ts:124:1 › Filling input with suggestions: Error: keyboard.press: Test ended. https://github.com/enso-org/enso/actions/runs/8084900399/job/22091252440

[enso-bot[bot]]

Adam Obuchowicz reports a new STANDUP for today (2024-02-02):

Progress: Gathered some CI failures related to new tests from CI. Examined and created PR with fixes. Also made another PR with small fixes like "select node after creating". Also, made an urgent fix for broken develop after last big change It should be finished by 2024-02-07.

Next Day: Next day I will be working on the same task. Check if any other failure will show up. Or take another task.

[farmaazon]

"Binding not found" is not test issue, and it seems it's a bug of one of our dependencies: https://github.com/Menci/vite-plugin-top-level-await/issues/25. I've created a PR to remove it.

[enso-bot[bot]]

Adam Obuchowicz reports a new 🔴 DELAY for today (2024-02-21):

Summary: There is 14 days delay in implementation of the GUI E2E tests transient failures (#8942) task. It will cause 0 days delay for the delivery of this weekly plan.

Delay Cause: Yesterday fiilled delay (and standup) to wrong issue: https://github.com/enso-org/enso/issues/9049#issuecomment-1954676481

Possible solutions: Be more wary

[enso-bot[bot]]

Adam Obuchowicz reports a new STANDUP for today (2024-02-21):

Progress: Finished fixing click handlers and a bit more. Created a PR. It should be finished by 2024-02-21.

Next Day: Next day I will be working on the #9058 task. Start working on drop down filtering.

[Akirathan]

Bumped into:

 INFO ide_ci::program::command: npmℹ️   1) componentBrowser.spec.ts:124:1 › Filling input with suggestions ───────────────────────────────
 INFO ide_ci::program::command: npmℹ️ 
 INFO ide_ci::program::command: npmℹ️     Test timeout of 30000ms exceeded.

in https://github.com/enso-org/enso/actions/runs/8084013760/job/22088345557?pr=9075#step:8:671

That does not seem to be covered by the list in the description.

GitHub

Move benchmark download tool and visualization to the CI · enso-org/enso@846e02e

Hybrid visual and textual functional programming. Contribute to enso-org/enso development by creating an account on GitHub.

[enso-bot[bot]]

Adam Obuchowicz reports a new 🔴 DELAY for today (2024-03-01):

Summary: There is 12 days delay in implementation of the GUI E2E tests transient failures (#8942) task. It will cause 3 days delay for the delivery of this weekly plan.

Delay Cause: New failures emerged.

[enso-bot[bot]]

Adam Obuchowicz reports a new STANDUP for today (2024-03-01):

Progress: Fixed last problems I found with E2E tests. Also, added config to eslint to catch missing awaits (the most common problem so far). And, to make investigation easier, make reports with exact trace to be downloaded from GH actions. It should be finished by 2024-03-04.

Next Day: Next day I will be working on the #9058 task. Resume work on filtering.

[farmaazon]

The issues in this task seem to be fixed. Closing for now, let's report new issues in new issues.