Flaky / failing unit tests - Githubissues

SRGSSR / srguserdata-apple

A framework to store user data and synchronize it with an account

MIT License

1 stars 0 forks source link

Flaky / failing unit tests #7

Open pyby opened 1 year ago

pyby commented 1 year ago

Issue type

Incorrect behavior

Description of the problem

Some unit tests are failing or flaky:

For some of them, the problem existed since months, failing on our CI, and are disabled:

DataStoreTestCase.testGlobalCancellation

Other ones are failing sometimes, and 15 retries seems to have passed tests on our CI. We try to keep its:

UserObjectTestCase.testDiscardForLoggedInUser
UserObjectTestCase.testDiscardForLoggedOutUser
UserObjectTestCase.testObjectsMatchingPredicate
UserObjectTestCase.testSynchronizeDeletedEntryExistingLocally
UserObjectTestCase.testSynchronizeDeletedEntryMoreRecentLocally
UserObjectTestCase.testSynchronizeMoreRecentDirtyLocalEntry

We should investigate these issues and fix them.

Environment information

Library version: 3.3.0
iOS / tvOS version: 16.x on simulators
Device: Any

Reproducibility

Always reproducible but randomly

Steps to reproduce

Run bundle exec fastlane iOS tests.