Open sergei-maertens opened 3 months ago
Interestingly enough, this doesn't seem to happen with a production build since our CI is passing: https://github.com/open-formulieren/open-forms-sdk/actions/runs/8340149970/job/22823603724?pr=663
We have the same problem. If I add await waitForPageReady(page);
i runs less flakky.
const config: TestRunnerConfig = {
async preVisit(page, story) {
await waitForPageReady(page);
}
}
We have the same problem but adding waitForPageReady
stalls indefinitely on this line
await page.waitForLoadState("networkidle")
when running locally and in our CI flow it does not seem to do anything (get the SB_PREVIEW_API_0011
errors). In both we run identical docker containers
Edit: Figured out the discrepancy. In local storybook is running via storybook dev
and in CI its building storybook and running npx http-server storybook-static
. Seems linked to this issue
I'm having the same issue, it happens when running storybook dev with the --ci flag (Without the CI flag, when the playground webpage is opened, this does not occur). However, it seems to resolve if I immediately run test-runner after this fail, but it takes longer than usual (10s as opposed to around 4s). Another consecutive call to test-runner takes the expected duration.
This only seems to happen in one specific instance, which also relies on Apollo GraphQL client mocked provider and is overall more complex. Smaller standalone packages with simple components do not seem to have this issue, and the tests run successfully.
For reference, this is the output from storybook info, using Vite:
Storybook Environment Info:
System:
OS: Linux 6.5 Debian GNU/Linux 11 (bullseye) 11 (bullseye)
CPU: (12) x64 12th Gen Intel(R) Core(TM) i7-1265U
Shell: 5.1.4 - /bin/bash
Binaries:
Node: 18.19.1 - /usr/local/bin/node
Yarn: 1.22.19 - /usr/local/bin/yarn
npm: 10.2.4 - /usr/local/bin/npm <----- active
pnpm: 8.15.4 - /usr/local/share/npm-global/bin/pnpm
npmPackages:
@storybook/addon-essentials: ^8.0.5 => 8.0.5
@storybook/addon-interactions: ^8.0.5 => 8.0.5
@storybook/addon-links: ^8.0.5 => 8.0.5
@storybook/addon-onboarding: ^8.0.5 => 8.0.5
@storybook/blocks: ^8.0.5 => 8.0.5
@storybook/react: ^8.0.5 => 8.0.5
@storybook/react-vite: ^8.0.5 => 8.0.5
@storybook/test: ^8.0.5 => 8.0.5
@storybook/test-runner: ^0.17.0 => 0.17.0
eslint-plugin-storybook: ^0.8.0 => 0.8.0
storybook: ^8.0.5 => 8.0.5
Any updates on this? I am having the exact same problem.
Same here! Same problem.
I'm doing the same thing where I'm using preVisit to set the viewport in some of our tests. In development mode, we see these errors when using test-runner
. When building statically, we don't see the errors.
Same issue here in postVisit
hook
async postVisit(page, context) {
await waitForPageReady(page);
...
}
any update on this? We're getting the same problem, and the tests run flaky because of it.
@yannbf Have you had a chance to take a look at this?
Any update on this? I encountered the same issue too.
With a very small set of stories, test-storybook --maxWorkers=1
worked for me locally. Haven't tried yet on CI.
Describe the bug
We have the test-runner.js implement with the
preVisit
to apply the different viewports when running tests, per the README.After upgrading to Storybook 8, our tests fail in a flaky way, e.g.:
In the browser, there are no problems, only happens when using the test-runner.
To Reproduce
Unfortunately I don't see a way to reproduce this reliably, but our repository is public: https://github.com/open-formulieren/open-forms-sdk/tree/chore/662-sb-upgrade
and in a different tab/shell:
Expected behavior
Tests only run when the story story is ready
Screenshots n/a
System
Additional context
I have an outdated theme addon that needs to be replaced still, no idea if that could be messing things up :thinking:
The relevant code throwing the error appears to be this: https://github.com/storybookjs/storybook/blob/718ae4ad3352d2bc69f95c0cfab25b4b075e2308/code/lib/preview-api/src/modules/preview-web/Preview.tsx#L106