apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.35k stars 928 forks source link

[core] add parallelism argument for remove orphan files #4044

Closed LsomeYeah closed 3 weeks ago

LsomeYeah commented 1 month ago

Purpose

Linked issue: close #xxx

Allow users to freely adjust the number of thread for removing orphan files.

Tests

API and Format

Documentation

JingsongLi commented 3 weeks ago

+1