search

aaarendt / HMA_Validation

Validation of water balance estimates for HMA
1 stars 3 forks source link

Subset dask #12

Closed liuzheng-arctic closed 4 years ago

liuzheng-arctic commented 4 years ago
  1. Updated subset function to add more variables.
  2. add nc2zarr function
  3. add new aggregation function (save_agg_mascons_zarr in MAR/utils.py) to speed up aggregation process.
  4. add a demo notebook showcasing the performance improvement by using dask (10 times speed up) and more efficient xarray Dataset handling (another 8 times speed up).