eurec4a / how_to_eurec4a

Code examples to get you started with EUREC⁴A data.
https://howto.eurec4a.eu
MIT License
6 stars 20 forks source link

Cache improvements #105

Closed d70-t closed 1 year ago

d70-t commented 1 year ago

This PR

In total, a build which fully utilizes the cache is now below 2 minutes or so and this number will often only increase by the amout required to execude the changed notebooks.

d70-t commented 1 year ago

As we ar currently struggling to run just one copy of the book, I guess testing multiple versions is still quite a bit away. If we'd want to combine testing multiple versions with caching properly, we likely would also have to pin all the dependency versions (currently it could happen that some cached notebook content has been executed using a different version of some libraries than newly executed content). I guess the current behaviour is quite ok though. At least we are checking that the notebooks work in principle. And if they break, the most likely reason is, that data moved away...

For the environment.yml, it currently says python>=3.9, which mamba interprets as "get the newest".

Thanks for reviewing! 😄