Stackdriver / stackdriver-prometheus-sidecar

A sidecar for the Prometheus server that can send metrics to Stackdriver.
https://cloud.google.com/monitoring/kubernetes-engine/prometheus
Apache License 2.0
120 stars 43 forks source link

Feature request: Allow to set export interval per metric #228

Open sdenef-adeo opened 4 years ago

sdenef-adeo commented 4 years ago

Hello,

I would like to suggest a feature. It would be to allow to set an export interval (reporting interval) with the same kind of filter used for the include flag.

For example, according to a global 60s export interval, I want to be able to export a custom metric data point only once per 300s/5mn. Because this metric varies little (eg: from 80% to 90% takes 4h).

With this feature, I will be able to optimize the Stackdriver costs (less datapoints, decrease the bill) for my metrics according to my business/technical needs.

Regards, Sébastien

sdenef-adeo commented 4 years ago

Thanks to have linked my feature request to the PR.

FYI I think my request is not covered by the PR. Even if a user is aware about the Stackdriver metrics billing rules and he/she accepts to pay, it is better to provide a way to push only useful data. Using filters to decide which metrics to push is one option. Providing a way to manage the rate per metric could be an other option.

Hope this helps to better understand the need. Regards

igorpeshansky commented 4 years ago

@sdenef-adeo We understand that the PR was to advise the users of the costs they may incur, while your FR is to actually control those costs. That PR was referencing your FR and others as evidence that this is a real issue users face. We are currently looking into this problem from many angles, but don't have any updates on an actual solution yet.