canonical / prometheus-k8s-operator

This charmed operator automates the operational procedures of running Prometheus, an open-source metrics backend.
https://charmhub.io/prometheus-k8s
Apache License 2.0
21 stars 34 forks source link

Compress rules, jobs for cos-proxy #634

Open sed-i opened 1 month ago

sed-i commented 1 month ago

Issue

Some productions deployments have several megs of relation data just for alert rules, scrape jobs. Contributing factors to the high volume of reldata:

As a result, every event cos-proxy gets from nrpe relation-changed, results in reading/writing several megs of data, taking several seconds to complete. When many units are at play, model settling takes a long time.

In addition, relation data limit is 16M, and in common envs we already approach 25% of that.

Solution

TODO:

Context

Testing Instructions

Upgrade Notes

sed-i commented 1 month ago

As of writing, the diff between v0 and v1 is: image