search

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.44k stars 959 forks source link

[flink] Introduce PartitionListener to enable custom actions in the F… #4398

Closed Aitozi closed 3 weeks ago

Aitozi commented 3 weeks ago

…link committer for partitions.

Purpose

replace for: https://github.com/apache/paimon/pull/4386

Fix for https://github.com/apache/paimon/issues/4402

  1. Extract PartitionListener
  2. Add ReportHmsListener which will report the partition statistic to hms when partition is idle. (enable by default)

Tests

API and Format

Documentation