search

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.43k stars 957 forks source link

[core] Add avg/max/total compaction io size metric #4392

Closed Aitozi closed 3 weeks ago

Aitozi commented 3 weeks ago

Purpose

Some bucket level IO size metrics are removed in https://github.com/apache/paimon/pull/2930/files

This PR add the avg/max/total compaction input & output io size metrics back.

Tests

API and Format

Documentation

wwj6591812 commented 3 weeks ago

+1

JingsongLi commented 3 weeks ago

@Aitozi You can take a look to https://github.com/apache/paimon/pull/4391 too.

Aitozi commented 3 weeks ago

Can you update documentation and explain the meaning for new metrics?

Updated.