enso-org / enso

Enso Analytics is a self-service data prep and analysis platform designed for data teams.
https://ensoanalytics.com
Apache License 2.0
7.36k stars 323 forks source link

Random GUI CI failure: `assetSearchBar.spec.ts › complex flows` #11449

Open radeusgd opened 1 week ago

radeusgd commented 1 week ago

I've encountered random failures of GUI CI on my PR: https://github.com/enso-org/enso/actions/runs/11593712120/job/32278328851?pr=11440

INFO ide_ci::program::command: pnpm ℹ️ . ci:test: app/gui test: . test:e2e:     Test timeout of 60000ms exceeded.
app/gui test: . test:e2e:     Error: expect(locator).toHaveValue(expected)
app/gui test: . test:e2e:     Locator: getByTestId('asset-search-bar').getByPlaceholder(/(?:)/)
app/gui test: . test:e2e:     Expected string: ""
app/gui test: . test:e2e:     Received string: "name:foo"
app/gui test: . test:e2e:     Call log:
app/gui test: . test:e2e:       - expect.toHaveValue with timeout 60000ms
app/gui test: . test:e2e:       - waiting for getByTestId('asset-search-bar').getByPlaceholder(/(?:)/)
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" data-focused="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" data-focused="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" data-focused="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" data-focused="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" data-focused="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" data-focused="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       -   locator resolved to <input size="1" title="" data-rac="" type="search" value="name:foo" data-hovered="true" id="react-aria3165931452-:r60:" aria-label="Search through items" placeholder="Type to search, ctrl + click an item to search for related content." class="focus-child peer text relative z-1 w-full bg-transparent placeholder-primary/40"/>
app/gui test: . test:e2e:       -   unexpected value "name:foo"
app/gui test: . test:e2e:       133 |   await searchBarInput.selectText()
app/gui test: . test:e2e:       134 |   await searchBarInput.press('Backspace')
app/gui test: . test:e2e:     > 135 |   await test.expect(searchBarInput).toHaveValue('')
app/gui test: . test:e2e:           |                                     ^
app/gui test: . test:e2e:       136 |   await page.press('body', 'ArrowDown')
app/gui test: . test:e2e:       137 |   await test.expect(searchBarInput).toHaveValue('name:' + firstName)
app/gui test: . test:e2e:       138 | })
app/gui test: . test:e2e:         at /runner/_work/enso/enso/app/gui/e2e/dashboard/assetSearchBar.spec.ts:135:37
app/gui test: . test:e2e:     attachment #1: trace (application/zip) ─────────────────────────────────────────────────────────
app/gui test: . test:e2e:     test-results/assetSearchBar-complex-flows-Dashboard/trace.zip
app/gui test: . test:e2e:     Usage:
app/gui test: . test:e2e:         pnpm exec playwright show-trace test-results/assetSearchBar-complex-flows-Dashboard/trace.zip
app/gui test: . test:e2e:     

The related playwright report can be downloaded from the assets page of the workflow run: https://github.com/enso-org/enso/actions/runs/11593712120/artifacts/2123070541

farmaazon commented 1 week ago

@radeusgd unfortunately, the link you provided is no longer valid; the reports are erased upon re-run.

If spotted again, please download the report and upload it here before re-running.

farmaazon commented 1 week ago

@radeusgd I found similar failure on develop: https://github.com/enso-org/enso/actions/runs/11608023936/artifacts/2127048992 - as those runs are not re-run, I think it's safe to keep it in a link.