search

akauppi / GroundLevel-firebase-es

[ANCHORED] Stencil for operational web apps
https://groundlevel-sep22.web.app/
Other
23 stars 3 forks source link

Flakiness of Cypress tests, from command line #115

Closed akauppi closed 1 year ago

akauppi commented 1 year ago

The metrics.cy.js tests have a habit of timing out, on their first run.

Sometimes, this happens even on a subsequent run, but seldom.

Described in packages/app/KNOWN.md.

Development

It's mainly annoying, needing a new make test.

CI

Since we only get one shot, needed to skip those tests, for now. (please fix)

1) Central metrics, logs and samples end up in Realtime Database (when a user has signed in)
       Have metrics passed to Realtime Database:
     CypressError: `cy.task('getIncoming')` timed out after waiting `15000ms`.
akauppi commented 1 year ago

Hopefully solved by 612bd7c

akauppi commented 1 year ago

Still seeing this on WSL2, reopening

akauppi commented 1 year ago

Test on next.sep22 - might be gone now. (Emulator updates, especially one about parallel tests)

akauppi commented 1 year ago

Still seen in CI runs.

akauppi commented 1 year ago

Solved, also in CI. A curl-like "waky-waky" script seems to help. It takes 5s to wake up Firebase Emulators. After having done that, metrics tests pass. Without it, even with 15s timeout, the first one fails.

Weird. Right?