apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.46k stars 969 forks source link

[core] Reduce unnecessary manifest reading during orphan clean #4228

Closed bknbkn closed 2 months ago

bknbkn commented 2 months ago

Purpose

Read manifest to find used files will cost time, if the candidates is empty, we don't need to do that

Tests

API and Format

Documentation

wwj6591812 commented 2 months ago

+1