apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.13k stars 842 forks source link

[Feature] Introduce scan-ignore-delete for streaming read #3677

Open FangYongs opened 2 days ago

FangYongs commented 2 days ago

Search before asking

Motivation

There may will be delete record in paimon changelog. For the same data, some downstream jobs need to get the delete records, while some don't. We'd like to add a scan-ignore-delete option to allow downstream jobs to control whether to read the delete records.

Solution

No response

Anything else?

No response

Are you willing to submit a PR?