fractal-analytics-platform / fractal-tasks-core

Main tasks for the Fractal analytics platform
https://fractal-analytics-platform.github.io/fractal-tasks-core/
BSD 3-Clause "New" or "Revised" License
12 stars 5 forks source link

Cache the dowloaded Zenodo data in GitHub actions #583

Closed tcompa closed 8 months ago

tcompa commented 8 months ago

The advantage here (as compared to caching poetry environments, which we also do) is that:

  1. These are small datasets, so that their contribution to the GitHub cache size limit won't be relevant
  2. Their key is simply a DOI, and they are common to all tests (pip/poetry, core library vs tasks, different OSs, different Python versions...).

To do:

Note that something similar should be considered also in view of #565.