search

risingwavelabs / risingwave

Best-in-class stream processing, analytics, and management. Perform continuous analytics, or build event-driven applications, real-time ETL pipelines, and feature stores in minutes. Unified streaming and batch. PostgreSQL compatible.
https://go.risingwave.com/slack
Apache License 2.0
7.06k stars 581 forks source link

Apache Iceberg Nessie catalog support #16773

Open mango009 opened 6 months ago

mango009 commented 6 months ago

Is your feature request related to a problem? Please describe.

I would like to sink to Apache iceberg with Nessie catalog implementation

Describe the solution you'd like

When creating a iceberg sink, specify the catalog.type as Nessie

Describe alternatives you've considered

There's really no alternatives, Nessie is the only catalog type that support multi-table transaction on top of iceberg.

Additional context

No response

fuyufjh commented 6 months ago

@chenzl25 PTAL 👀

chenzl25 commented 1 month ago

I think Nessie catalog is trying to be compatible with iceberg rest catalog. If so, the existing rest catalog support is enough. https://projectnessie.org/guides/iceberg-rest

chenzl25 commented 1 week ago

@mango009 Did you try to use Nessie as a rest catalog before? https://projectnessie.org/guides/iceberg-rest