earth-mover / icechunk

Open-source, cloud-native transactional tensor storage engine
https://icechunk.io
Apache License 2.0
291 stars 17 forks source link

Add era5 virtualizarr example #360

Open mpiannucci opened 3 weeks ago

mpiannucci commented 3 weeks ago

Just a single file for now, starting point for building large virtual version

TomNicholas commented 2 weeks ago

In general I would encourage using vds vs ds as a convention to distinguish between datasets that contain ManifestArrays and those that don't. It's confusing otherwise because the top-level type is fundamentally unhelpful (see https://github.com/zarr-developers/VirtualiZarr/issues/171).