hypertest-cloud / hypertest

Plug-and-play library that distributes tests in the cloud to cut runtime to just your slowest test, ensuring cost-effectiveness.
https://hypertest.cloud
1 stars 0 forks source link

Verify deterministic order of cypress test runner #19

Closed marcinlesek closed 2 months ago

marcinlesek commented 6 months ago
marcinlesek commented 6 months ago

Tests results:

(Run Finished)

       Spec                                              Tests  Passing  Failing  Pending  Skipped
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  single-file.cy.ts                        00:24        6        6        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  directory/inside-dir.cy.ts               00:14        5        5        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  directory/long-test.cy.ts                00:12        1        1        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  directory/nested-dir/loops.cy.ts         00:18        6        6        -        -        - │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✔  All specs passed!                        01:08       18       18        -        -        -
marcinlesek commented 2 months ago

Oke, so flow changed and now we're creating batch of 100 generated tests with random wait time (in range from 0 to 3 seconds) and verify index of test run with number of generated tests.