azavea / noaa-hydro-data

NOAA Phase 2 Hydrological Data Processing
11 stars 3 forks source link

Investigate potential use of Kerchunk #24

Closed lewfish closed 1 year ago

lewfish commented 2 years ago

Someone tried using Kerchunk on NWM predictions on NOMADs and it failed due to throttling: https://github.com/fsspec/kerchunk/issues/104

lewfish commented 2 years ago

Also, as one would suspect, if you use kerchunk to read archival data (eg. NetCDF files), you will be stuck with whatever way it was chunked.

rajadain commented 1 year ago

Closing in favor of #127