earth-mover / icechunk

Open-source, cloud-native transactional tensor storage engine
https://icechunk.io
Apache License 2.0
292 stars 17 forks source link

Read-Only mode when checking out snapshot or tag #313

Closed dcherian closed 4 weeks ago

dcherian commented 1 month ago

Closes #237

mpiannucci commented 1 month ago

So if you checkout a tag or branch you can't make local changes either?

How does this work if you were load the store into xarray? It makes sense from robustness perspective but it seems very restrictive

Edit NVM read deepaks comment above!

dcherian commented 1 month ago

So if you checkout a tag or ~branch~ snapshot you can't make local changes either?

Yes. Not without explicitly switching the mode, and then any attempt to commit will still fail (no dangling commits are allowed). Some future flush API would need to be added to allow creating a new "dangling snapshot"

How does this work if you were load the store into xarray?

Yeah if you keep switching between tags and branch tip you'll need to explicitly switch the mode. something like ds.to_zarr(repo.store.with_mode("w-"))