search

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.43k stars 954 forks source link

[Bug] Skip overwriting the partition when no data append for dynamic … #4536

Closed Aitozi closed 3 days ago

Aitozi commented 6 days ago

…partition overwrite mode.

Purpose

If dynamic-partition-overwrite is enabled, the partition should not be overwrite when the input data is empty. Currently, we check the appendTableFiles, but it contains the DELETE files. We should exclude the DELETE files for check.

Linked issue: close #xxx

Tests

API and Format

Documentation

wwj6591812 commented 5 days ago

Thanks @Aitozi Left two small comments.