qonto / prometheus-rds-exporter

Prometheus exporter for AWS RDS
MIT License
69 stars 11 forks source link

The Latency and Transmit metric feature request #149

Closed davidmkrtchian closed 4 months ago

davidmkrtchian commented 7 months ago

Before adopting the RDS exporter, I relied on the CloudWatch exporter to gather AWS RDS metrics. However, I noticed that the RDS exporter lacks certain metrics that were available through CloudWatch. Specifically, I found that the following metrics are missing:

I would greatly appreciate it if these metrics could be incorporated into the RDS exporter. For reference, you can find the definitions of these metrics in the CloudWatch exporter's configuration file at the following location: CloudWatch Exporter - RDS Metrics.

vmercierfr commented 7 months ago

Thanks for raising this feature request. We don't purposely collect this data, but it's open to discussion.

We try to collect only metrics that are relevant for triggering alerts (part of the database monitoring framework) or for convenient visualizations in our dashboards (adopting USE methodology).

While network receives/transmit throughput could be relevant to identifying network interface saturation, we haven't seen environments where the network interface could be saturated. Even the smallest RDS instances, like T3/T4 family, have a 5 Gbps interface. Usually, the disk throughput (this metric is collected) is saturated well before the network.

Read/write disk latencies are helpful for deep performance analysis but probably incomplete since you may need enhanced monitoring and some other metrics to be able to identify bottlenecks (reference).

For these 2 use cases, our recommended approach is to keep the data in AWS CloudWatch and use a performance-oriented dashboard (example). It avoids Prometheus metrics storage cost, supports metric granularity set on your RDS instance, and allows specialized dashboards.

However, feel free to share alerts, runbooks, or production experiences that you may have with these metrics so we can evaluate if they can fit in this exporter.

vmercierfr commented 4 months ago

If you don't mind, I'll close this issue.

As an alternative, you may consider Cloudwatch exporter