search

apache / gravitino

World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.
https://gravitino.apache.org
Apache License 2.0
1.09k stars 343 forks source link

[Improvement] Reporting the metrics of the clientPool in hive, iceberg, and paimon #5575

Open caican00 opened 1 week ago

caican00 commented 1 week ago

What would you like to be improved?

We are using the gravitino iceberg rest server in Xiaomi to manage iceberg metadata.

Currently, the connection pools of the iceberg backend catalog have no observable metrics. we have collected the related metrics, such as the number of active connections, number of idle connections, and the size of the connection pool in iceberg hiveClientPool, and reported to prometheus.

In addition to this, I think it is also possible to collect metrics of hive and Paimon-related connection pools to improve the observability of the service.

How should we improve?

No response

FANNG1 commented 1 week ago

Very useful feature, do you plan to export the metrics by the metrics system provided by Gravitino?

caican00 commented 1 week ago

Very useful feature, do you plan to export the metrics by the metrics system provided by Gravitino?

yes.