Open bendichter opened 1 year ago
A nice-to-have feature would be to enhance ZarrIO.export (https://github.com/hdmf-dev/hdmf-zarr/blob/d47fc8249e76a371fff990b07218a088e59ea590/src/hdmf_zarr/backend.py#L231) to use parallel write when converting from HDF5 to Zarr. One way to achieve this would be to automatically wrap datasets in DataChunkIterator in ZarrIO.write_dataset. This is probably beyond this PR and can be addressed later in a separate issue. Just wanted to mention it.
ZarrIO.export
ZarrIO.write_dataset
Originally posted by @oruebel in https://github.com/hdmf-dev/hdmf-zarr/issues/111#issuecomment-1657372819
A nice-to-have feature would be to enhance
ZarrIO.export(https://github.com/hdmf-dev/hdmf-zarr/blob/d47fc8249e76a371fff990b07218a088e59ea590/src/hdmf_zarr/backend.py#L231) to use parallel write when converting from HDF5 to Zarr. One way to achieve this would be to automatically wrap datasets in DataChunkIterator inZarrIO.write_dataset. This is probably beyond this PR and can be addressed later in a separate issue. Just wanted to mention it.Originally posted by @oruebel in https://github.com/hdmf-dev/hdmf-zarr/issues/111#issuecomment-1657372819