apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.46k stars 966 forks source link

[core] Support add partition for paimon #4323

Closed xuzifu666 closed 1 month ago

xuzifu666 commented 1 month ago

Purpose

Currently paimon can not support add partition, due to add partition not need commit transaction,so make hms sync to achieve it.

Linked issue: close #xxx

Tests

API and Format

Documentation

xuzifu666 commented 1 month ago

I think you should use MetastoreClient to add partition. The implementation can be in AbstractCatalog.

I think you should use MetastoreClient to add partition. The implementation can be in AbstractCatalog.

Yes, move to AbstractCatalog maybe better, would change as it. Thanks @JingsongLi