[Bug] The partition statistic is not correct in hms

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

https://paimon.apache.org/

Apache License 2.0

2.43k stars 957 forks source link

[Bug] The partition statistic is not correct in hms #4402

Closed Aitozi closed 3 weeks ago

Aitozi commented 3 weeks ago

Search before asking

[X] I searched in the issues and found nothing similar.

Paimon version

0.9

Compute Engine

Flink

Minimal reproduce step

The flink writer only report to hms when the partition is first written into, which lead to the partition size & row count metadata are not correct in hms.

apache / paimon

[Bug] The partition statistic is not correct in hms #4402

Search before asking

Paimon version

Compute Engine

Minimal reproduce step

What doesn't meet your expectations?

Anything else?

Are you willing to submit a PR?