Closed sankala-dremio closed 3 years ago
What does the real Prometheus server do in this case? We should do what it does, I think.
Prometheus Server accepts and renders time series metric irrespective of presence of "_sum". Hence prometheus receiver should at least do the same. I can submit a PR for this change if agreed upon this behavior.
@odeke-em is working on this.
Brian B. stated in today's meeting that Prometheus will accept Summaries without "_cnt" as well as without "_sum" and/or without any quantiles.
The Prometheus receiver wasn’t necessarily the problem but it was the exporter as I showed in https://github.com/open-telemetry/opentelemetry-collector/issues/2661#issuecomment-813871810 and fixed by PR https://github.com/open-telemetry/opentelemetry-collector/pull/2900
Let’s close this issue as the change to the collector just got merged. Thanks everyone for the discussion.
@odeke-em it was also this https://github.com/open-telemetry/opentelemetry-collector/pull/2812 that helped
Gotcha, thank you @bogdandrutu for the follow up.
Currently, when Timeseries data is scraped by Prometheus Scraper, it expects bucketed data and two counters along with those buckets - _count and _sum. Some frameworks do no capture the _sum and hence do not produce the _sum counter in the Prometheus Exp format. While the Scraper and Prometheus work fine and display appropriate graphs without this counter, Prometheus receiver on the other hand expects this counter to be present for all time series metrics and if not present silently ignores the metric and associated datapoints.
Is this really the desired behavior for PrometheusReceiver?