apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.44k stars 959 forks source link

[core] Introduce compactionCompletedCount/compactionQueuedCount metrics. #4391

Closed zhuyaogai closed 3 weeks ago

zhuyaogai commented 4 weeks ago

Purpose

Linked issue: https://github.com/apache/paimon/issues/4063 and add some metrics about compaction for paimon (includes compactionsCompletedCount/compactionsQueuedCount).

Tests

Existing tests

API and Format

No

Documentation

No

zhuyaogai commented 4 weeks ago

@JingsongLi hi, master, could you help me review this? Thanks!

zhuyaogai commented 3 weeks ago

Can you update documentation and explain the meaning for new metrics?

done.