Support MOR CDC view - Githubissues

apache / iceberg

Apache Iceberg

https://iceberg.apache.org/

Apache License 2.0

6.47k stars 2.24k forks source link

Support MOR CDC view #8975

Closed puchengy closed 1 month ago

puchengy commented 1 year ago

Feature Request / Improvement

Currently Iceberg table that is being upserted by Flink can not produce CDC view.

Error: Delete files are currently not supported in changelog scans

This is due to all below reasons together:

Flink upsert only support v2 Iceberg table.
Flink upsert only use MOR and can not use COW.
Iceberg CDC does not support MOR.

It will be great to support this feature.

Query engine

Spark

puchengy commented 1 year ago

@aokolnychyi @flyrain Hello, do you know how much effort this will take to implement? Thanks!

coolderli commented 10 months ago

@flyrain @puchengy any update for supporting this? Is there any plan for supporting Flink streaming read? Thanks.

github-actions[bot] commented 1 month ago

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

github-actions[bot] commented 1 month ago

This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'