chromaui / chromatic-e2e

Archive end-to-end tests to be replayed in Storybook and Chromatic
MIT License
21 stars 4 forks source link

:bug: Fix issue where the networkTimeout wasn't renamed everywhere. #26

Closed jwir3 closed 11 months ago

jwir3 commented 11 months ago

The commit that previously renamed networkTimeout to resourceArchiveTimeout didn't get all of the places where it should've been renamed. This commit fixes that issue.

Refs AP-3761.

Issue: #

What Changed

How to test

Change Type

📦 Published PR as canary version: 0.0.30--canary.26.d274d5c.0
:sparkles: Test out this PR locally via: ```bash npm install @chromaui/test-archiver@0.0.30--canary.26.d274d5c.0 # or yarn add @chromaui/test-archiver@0.0.30--canary.26.d274d5c.0 ```
linear[bot] commented 11 months ago
AP-3761 CDP failures are causing tests to fail

**What** A [customer](https://chromaticqa.slack.com/archives/C05L6F1TYEA/p1697555064653969) sees tests failing when using `chromaui/test-archiver` that aren't failing when only using `playwright-test`. test-archiver is timing out after a specified interval (`2000 ms` currently), and some of the resources (`.woff` font files) are taking longer than that to load, so we're throwing an [error](https://github.com/chromaui/test-archiver/blob/main/src/resource-archive/index.ts#L66), which fails the spec. **Reproducing the error** I can reproduce by putting the following spec into a typical Playwright project, then running `npx playwright test`: ``` test('has title', async ({ page }, testInfo) => { await page.goto('https://www.getty.edu/art/collection/search?images=true&q=sculpture'); // Expect a title "to contain" a substring. await expect(page).toHaveTitle(/Search for keyword: 'sculpture', with Images \(Getty Museum\)/); }); ``` **Possible solutions** I don't experience the problem if I increase the [network timeout](https://github.com/chromaui/test-archiver/blob/main/src/resource-archive/index.ts#L5) (anything above `5000 ms`). Not sure if there's a reason it is currently at `2000 ms`, though (perhaps that makes the tests finish more quickly if all is well).

jwir3 commented 11 months ago

@thafryer Super quick follow-up to the last PR. I neglected to change it everywhere it needed to be.

thafryer commented 11 months ago

:rocket: PR was released in v0.0.30 :rocket: