freedomofpress / securedrop

GitHub repository for the SecureDrop whistleblower platform. Do not submit tips here!
https://securedrop.org/
Other
3.62k stars 685 forks source link

CI Tests Are Failing Intermittently #6545

Open nathandyer opened 2 years ago

nathandyer commented 2 years ago

Description

I've noticed that recent CI builds for the securedrop repo are failing for seemingly no reason. Re-running the tests (without any code changes) will allow the tests to eventually pass.

Steps to Reproduce

Trigger a new CI build

Expected Behavior

It builds with all tests succeeding

Actual Behavior

Test builds are intermittent. For example, from within Circle CI you can see where builds from the branch I created yesterday have alternated between being successful, failing on the app-tests, and failing on admin-tests this morning.

Yesterday I did have some code changes that broke the tests, but all the failures today were happening outside of my code changes.

I've noticed similar failures on other CI tests this morning and afternoon that don't appear to correspond to underlying code issues.

Comments

eloquence commented 2 years ago

app-page-layout-tests failure, also assert None == 200: https://app.circleci.com/pipelines/github/freedomofpress/securedrop/4710/workflows/139ff84c-73f7-4961-9349-863400896a42/jobs/64016