search

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.43k stars 955 forks source link

[core] Introduce drop-deleted-record-count compaction metric. #4487

Closed zhuyaogai closed 1 week ago

zhuyaogai commented 1 week ago

Purpose

Linked issue: close #xxx

Introduce a metric that records the number of records(DELETE(-D)) that have been dropped by compaction.

Tests

No

API and Format

No

Documentation

No

zhuyaogai commented 1 week ago

Updated @wwj6591812

JingsongLi commented 1 week ago

Can you explain the real usage in production env? I cannot get why from Introduce a metric that records the number of records(DELETE(-D)) that have been dropped by compaction..

JingsongLi commented 1 week ago

Feel free to re-open this if you think it is true requirement.