search

brainglobe / brainglobe-workflows

Workflows that utilise BrainGlobe tools to perform data analysis and visualisation.
BSD 3-Clause "New" or "Revised" License
9 stars 2 forks source link

Detect dependency breaks [Feature] #57

Open sfmig opened 11 months ago

sfmig commented 11 months ago

Chatting with @alessandrofelder we thought that running the benchmarks periodically could also serve (albeit indirectly) to detect dependency breaks.

However since this is a somewhat indirect way to test this, we suggested adding an additional CI workflow to regularly run the workflow tests and detect this kind of breaks.

Stretch goal: add accuracy checks (we want to flag if accuracy / performance changes when a dependency changes)

sfmig commented 11 months ago

Consider adding smoke tests for integration tests