conda-incubator / conda-store

Data science environments, for collaboration. ✨
https://conda.store
BSD 3-Clause "New" or "Revised" License
143 stars 46 forks source link

[ENH] Investigate where mocking can be used in unit tests to improve flakiness, speed up test suite #816

Open peytondmurray opened 5 months ago

peytondmurray commented 5 months ago

Context

Currently there are many unit tests which are not very isolated. For example many tests reach out to conda-forge, and are therefore at risk of producing false failures for any number of network-related issues that are unrelated to the code being tested.

This issue is to plan and potentially track the work needed to mock out external dependencies, better isolating the unit tests to the code that we actually want to test.

One suggestion has been to run our own package repository locally, making it unnecessary for conda-store to make requests to conda-forge.

Value and/or benefit

The test suite is currently flaky. This should help reduce flakiness and has the potential to greatly speed up testing, as waiting on external resources takes a lot of time.

Anything else?

No response

trallard commented 2 months ago

Marking as in progress since @peytondmurray is currently working on this