hdmf-dev / hdmf-zarr

Zarr I/O backend for HDMF
https://hdmf-zarr.readthedocs.io/
Other
7 stars 7 forks source link

[Feature]: Updates to Zarr Backend #121

Closed mavaylon1 closed 4 months ago

mavaylon1 commented 11 months ago

What would you like to see added to HDMF-ZARR?

ZarrIO needs to be updated to follow HDF5IO in how it handles:

  1. Writing references at the end via a queue
  2. Making sure the references are created in the same way to avoid extra checks to search for the target.
  3. Update the workflow on write_dataset on ZarrIo, but also verify that write_dataset on HDMF is proper (specifically in how both handle references). For example, clarify why ZarrIO uses HDMFDataset as a conditional in write_dataset.
  4. Export needs to be updates to current HDMF version
  5. Both ZarrIO and the reference wrapper classes can be abstracted to decrease the amount of code duplication.
  6. Currently there is an issue with convert_dtype that converts the dtype from uint32 to just int32. This can be reproduced by running the plot_io_convert_nwb_hdf5.py

Is your feature request related to a problem?

No response

What solution would you like?

Update to the backend.

Do you have any interest in helping implement the feature?

Yes.

Code of Conduct