Improve performance of prognostic diagnostics

ai2cm / fv3net

explore the FV3 data for parameterization

MIT License

16 stars 3 forks source link

Open nbren12 opened 3 years ago

nbren12 commented 3 years ago

Currently, there is a ton of repeated downloading of data for different diagnostics. It would be much cheaper to use fsspec's builtin caching mechanism: https://filesystem-spec.readthedocs.io/en/latest/features.html#caching-files-locally

cc @oliverwm1

mcgibbon commented 2 years ago

info: workflows/diagnostics/fv3net/prognostic_run/emulation/single_run.py function open_zarr has a fix like this.

mcgibbon commented 2 years ago

Fix for this appears to be in branch report-improvments-v2