search

zarr-developers / VirtualiZarr

Create virtual Zarr stores from archival data files using xarray syntax
https://virtualizarr.readthedocs.io/en/stable/api.html
Apache License 2.0
124 stars 24 forks source link

Test against Zarr v3 in CI #263

Closed TomNicholas closed 1 month ago

TomNicholas commented 1 month ago

If we add CI workflows that use the bleeding edge versions of upstream dependencies, we can use it to test against zarr-python-v3.

If we add another env that uses upstream versions but only the minimum dependencies (i.e. no kerchunk), then we can use that to test Icechunk integration against.

We may also want to add another env to test V3 with kerchunk.

This way we can start testing every feature against each version of key dependencies, in a way that will still be a somewhat sane setup even after the whole ecosystem works with zarr-python-v3.

TomNicholas commented 1 month ago

I just realised that what I'm trying to achieve is the same as what @ghidalgo3 already suggested in https://github.com/zarr-developers/VirtualiZarr/pull/182#issuecomment-2221406618. The difference is that now we can run the tests (skipping a lot of them https://github.com/zarr-developers/VirtualiZarr/pull/259) without kerchunk installed