[Feature]: Explore use of Zarrita

[oruebel]

What would you like to see added to HDMF-ZARR?

See https://github.com/NeurodataWithoutBorders/nwb_benchmarks/issues/65

Zarrita is a prototype implementation of Zarr v3 with support for sharding. It may have better performance than normal Zarr.

Is your feature request related to a problem?

Sharding helps address the issue of many files and is something that also DANDI is interested in. Since this is Zarr v3 it is exploratory right now, but is something we should get an understanding off so that we are ready when the feature becomes available and also so we can provide feedback early on in case we discover issues.

What solution would you like?

...

Do you have any interest in helping implement the feature?

Yes.

Code of Conduct

• [X] I agree to follow this project's Code of Conduct
• [X] Have you checked the Contributing document?
• [X] Have you ensured this change was not already requested?

[mavaylon1]

@oruebel Interesting. Let's add this as a discussion item in the coming weeks during lunch.

[oruebel]

Let's add this as a discussion item in the coming weeks during lunch.

Sounds good.