grafana / cortex-jsonnet

Deprecated: see https://github.com/grafana/mimir/tree/main/operations/mimir instead
Apache License 2.0
74 stars 55 forks source link

Query 'min step' of 1m loses fine detail #339

Closed bboreham closed 3 years ago

bboreham commented 3 years ago

I find this setting problemmatic: https://github.com/grafana/cortex-jsonnet/blob/b32d0421a0d5e6258dfb60e41a863c20e7e49170/cortex-mixin/dashboards/dashboard-utils.libsonnet#L87

It is shown in the Grafana UI as 'min step'.

Here it is documented that $__rate_interval will be floored at 4x this quantity, i.e. 4 minutes. This makes it impossible to see fast transients in the data.

Further, Cortex query-frontend will quantise start and end times to a multiple of the step time, so dashboards only change every minute.

Since we are scraping at 15s I propose "min step" should be 15s.