Thank you for developing this really useful project.
We have our metrics migrate over to Thanos for long term storage after living in Prometheus for 24 hours. For some reason the queries for the remaining error budget are not getting properly calculated and returns a NaN. When I change the data source from Thanos to Prom things work as expected.
I can get values from some of the prom queries when I run them individually but when I run the entire expression it chokes.
These work ad-hoc against the Thanos datasource and returns the expected value.
slo:sli_error:ratio_rate1h{sloth_service="mfplaid-api",sloth_slo="requests-availability"}slo:error_budget:ratio{sloth_service="mfplaid-api",sloth_slo="requests-availability"} *on() group_left() (24 * days_in_month())
But when I execute the entire expression it returns NaN.
Thank you for developing this really useful project.
We have our metrics migrate over to
Thanos
for long term storage after living in Prometheus for 24 hours. For some reason the queries for theremaining error budget
are not getting properly calculated and returns a NaN. When I change the data source from Thanos to Prom things work as expected.I can get values from some of the prom queries when I run them individually but when I run the entire expression it chokes.
These work ad-hoc against the Thanos datasource and returns the expected value.
slo:sli_error:ratio_rate1h{sloth_service="mfplaid-api",sloth_slo="requests-availability"}
slo:error_budget:ratio{sloth_service="mfplaid-api",sloth_slo="requests-availability"} *on() group_left() (24 * days_in_month())
But when I execute the entire expression it returns
NaN
.Any clues that may help me?
Thanks Again!