We need to ensure, Dask arrays are efficently used when loading very large dataset.
Introduce new input parameter input/prefetch_chunks that will force fetching the internal NetCDF chunking from a first of a set of input files. We will then use this chunk sizes to open all input files.
We need to ensure, Dask arrays are efficently used when loading very large dataset.
Introduce new input parameter
input/prefetch_chunks
that will force fetching the internal NetCDF chunking from a first of a set of input files. We will then use this chunk sizes to open all input files.