search

Assimila / DQTools

Tools for working with the DataCube. Includes reading metadata, registering new products and writing new data to the Datacube
0 stars 0 forks source link

Use DASK for large datasets #19

Closed purplecat7 closed 3 years ago

purplecat7 commented 3 years ago

It becomes time consuming and memory hogging to pickle/zip very large datasets across the http interface. Use dask to return a memory pointer to a vrt file.

Require support through DQClient request and into Exporter. see issue 80 in datacube repo.

purplecat7 commented 3 years ago

DASK branch

bb0fc54f DASK support in http client