Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
2.43k
stars
955
forks
source link
[core] Add batch add partitions in MetastoreClient #4480
Closed
Zouxxyy closed 1 week ago
Purpose
hiveClient support
client.add_partitions
to add partitions at once, we can use it in AddPartitionCommitCallbackthis speeds up the load table a lot when have many partitions to sync.
Tests
API and Format
Documentation