apache / iceberg

Apache Iceberg
https://iceberg.apache.org/
Apache License 2.0
6.12k stars 2.13k forks source link

Add DellEMC ECS catalog support #2806

Closed mechgouki closed 1 month ago

mechgouki commented 3 years ago

This issue is to add a new catalog which will make Apache iceberg support DELL EMC ECS , ECS is Enterprise object storage platform from Dell EMC, ECS delivers rich S3-compatibility on a globally distributed architecture, empowering organizations to support enterprise workloads such as cloud-native, archive, IoT, AI, and big data analytics applications at scale. It will be valuable to support it in Apache Iceberg official repo to bring Apache Iceberg ecosystem into enterprise hybrid cloud solution which built on ECS today.

In the ECS catalog implementation (PR will submit soon), we will use the pure S3 interface (instead of S3A) plus ECS API extension (Append/If-Match/If-None-Match) to have the better performance and scalability. It could be a reference on how to connect Iceberg to S3 compatible object Storage. (however it cannot directly used on other S3 compatible object Storage if they don’t have the required API extension.)

github-actions[bot] commented 1 month ago

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

github-actions[bot] commented 1 month ago

This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'