Centralize walking of the zarr folders for checksum/upload purposes

dandi / dandi-cli

DANDI command line client to facilitate common operations

https://dandi.readthedocs.io/

Apache License 2.0

22 stars 28 forks source link

Centralize walking of the zarr folders for checksum/upload purposes #1387

Open yarikoptic opened 10 months ago

yarikoptic commented 10 months ago

Inspired by revelations etc in

https://github.com/dandi/dandi-cli/pull/1371

ideally should be the same walker to be used by dandi-cli and anything else (e.g. dandi-archive) which is interested in computing the checksum over zarr

https://github.com/dandi/zarr_checksum/issues/50 which suggests a somewhat larger scoped generalization of the zarr_checksum.