function to merge multiple stores

czbiohub-sf / shrimPy

shrimPy: Smart High-throughput Robust Imaging & Measurement in Python

BSD 3-Clause "New" or "Revised" License

8 stars 1 forks source link

function to merge multiple stores #107

Closed edyoshikun closed 5 months ago

edyoshikun commented 1 year ago

This PR adds a dataset merging function. This is currently not a CLI, but it can be made if we see fit. This function is currently is used in a slurmkit script that is ran after stabilizing. Additionally this utils.merge_datasets() function can be used to copy new zarr stores in parallel, which is certainly faster than running cp source/path target/path.

edyoshikun commented 5 months ago

closing this in favor of #145