Open qianqianwang-microsoft opened 4 days ago
My own opinion is that the maintenance burden would be lower if icechunk used one API on top of the object_store
crate rather than reimplementing object store operations individually for S3, GCS, and Azure.
@qianqianwang-microsoft - thanks so much for this PR! We are really excited to work with you to support Azure in Icechunk!
@kylebarron thanks for chiming in. I generally agree with you. We had some good discussion of this in https://github.com/earth-mover/icechunk/issues/266#issuecomment-2455881019. But that discussion stalled out (and @paraseba is OoO this week.)
We are very open to using an object_store-based approach in Icechunk, provided that:
Adding support for azure blob storage using azure_storage and azure_storage_blobs crates. This PR is still a WIP.