risingwavelabs / risingwave

Best-in-class stream processing, analytics, and management. Perform continuous analytics, or build event-driven applications, real-time ETL pipelines, and feature stores in minutes. Unified streaming and batch. PostgreSQL compatible.
https://go.risingwave.com/slack
Apache License 2.0
6.92k stars 572 forks source link

Implement `CoordinatedSinkWriter` for iceberg sink. #10642

Closed liurenjie1024 closed 1 year ago

ZENOTME commented 1 year ago

After https://github.com/icelake-io/icelake/issues/74, can we do this now? Seems we sperate writer and commiter.

liurenjie1024 commented 1 year ago

Yes, we do this now.