jennifer-shehane
commented
4 years ago Seems to be not moving on from this beforeEach / it definition in the tests in the case you linked to (shown below).
Does it always fail on this same specfile?
If there's something intermittent, then there's likely some asynchronous that gets into this loop sometimes if the timing of the run is slightly different sometimes. It's going to be hard to track down without the full code base.
You may want to try some of the recommendations on troubleshooting why tests fail in CI but pass locally: https://on.cypress.io/using-cypress-faq#Why-do-my-Cypress-tests-pass-locally-but-not-in-CI
beforeEach(() => {
window.testState = testState;
const failHandler = err => {
Cypress.off("fail", failHandler);
testState.onFail(err);
throw err;
};
Cypress.on("fail", failHandler);
})
it('I enable showPageSizeSelection', () => {
const state = window.testState;
return cy
.then(() => state.onStartScenario(scenario, indexedSteps))
.then(() =>
resolveAndRunBeforeHooks.call(this, scenario.tags, state.feature.name)
.then(() =>
indexedSteps.forEach(step => stepTest.call(this, state, step, rowData)))
.then(() =>
resolveAndRunAfterHooks.call(this, scenario.tags, state.feature.name))
.then(() =>
state.onFinishScenario(scenario)
);
})
jamime
Current behavior:
Our builds are failing intermittently, restarting the build usually results in a successful build. We're using cypress dashboard to orchestrate 20 CI machines.
Here is an example of a build that ran for almost 2 hours without any progress. https://github.com/Sage/carbon/runs/848939252?check_suite_focus=true
The build typically takes ~10 mins.
Here is the log from the step that failed. Here is the log from a different PR that also failed.
Desired behavior:
Builds should consistently pass.
Test code to reproduce
Running the cypress build will intermittently fail on this commit.
https://github.com/Sage/carbon/tree/6116e86b19145bba6d702434afb06ab4621c784c
Versions
Cypress: 4.9.0 CI: GitHub Actions GitHub Action: cypress-io/github-action@v2.2.1