CNES / zcollection

Python library allowing to manipulate data split into a collection of groups stored in Zarr format.
https://zcollection.readthedocs.io/en/latest/
BSD 3-Clause "New" or "Revised" License
12 stars 3 forks source link

add 'variables' parameters for view.update() #13

Open robin-cls opened 1 month ago

robin-cls commented 1 month ago

A Collection can specify the variables that will be updated using the Collection.update() method. This prevents zcollection having to guess the updated variables by launching the callback over the first partition. This is very useful if the callback needs heavy auxiliary data that can only be loaded on a dask worker.

A View cannot use the same 'variables' and cannot bypass this variables inference step. It would be a great for View.update() to have the same behavior as the Collection