apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.13k stars 842 forks source link

[core] Introduce scan-ignore-delete for streaming read #3681

Open FangYongs opened 2 days ago

FangYongs commented 2 days ago

Purpose

Linked issue: close #3677

Introduce scan-ignore-delete for streaming read

Tests

  1. Added test unit PrimaryKeyFileStoreTableITCase#testLookupChangelogIgnoreDelete

API and Format

no

Documentation

no

JingsongLi commented 2 days ago

Maybe just use audit_log table?