elastic / integrations

Elastic Integrations
https://www.elastic.co/integrations
Other
26 stars 438 forks source link

Prometheus integration not scraping summary metrics #9265

Open Alphayeeeet opened 8 months ago

Alphayeeeet commented 8 months ago

Everything is literally mentioned in the discussion post, but no one cared about it and therefore there are no answers.

For confirmed bugs, please report:

pierrehilbert commented 8 months ago

@bturquet could someone have a look here please?

bturquet commented 8 months ago

@lalit-satapathy This request is for you as it as about Prometheus, thank you !

lalit-satapathy commented 8 months ago

Refer old beats issue: https://github.com/elastic/beats/issues/37376

@ishleenk17, Can you summarise what needs to happen here and if it is ready to be taken next?

ishleenk17 commented 8 months ago

@Alphayeeeet : I am looking into it. Will get back to you soon!

ishleenk17 commented 8 months ago

Hello,

I tried out with a service having summary metrics as below:

Screenshot 2024-03-12 at 8 34 40 PM

I see them getting indexed in the ES:

Screenshot 2024-03-12 at 8 34 30 PM

For getting the summary metrics, please ensure the use_types and rate counters are enabled (these are enabled by default)

Screenshot 2024-03-12 at 8 35 49 PM

Please let me know if this helps.

Alphayeeeet commented 8 months ago

@ishleenk17 Thank you for the reply.

I have the following prometheus metric: image

...which I do net get in the event:

image

Maybe it has something to do with the mappings? My events are just ingested as numbers. Still there are no separate values for each quantile (which should be available in my opinion, maybe configurable if it's optional)

My agent config is the following:

image

ishleenk17 commented 8 months ago

Still there are no separate values for each quantile (which should be available in my opinion, maybe configurable if it's optional)

We don't give direct values of quantiles. Although, if you would want to check the values you can see from the ".value" field of the metric and then by opening the event you can see the quantile it corresponds to

Screenshot 2024-03-13 at 10 15 53 AM
Alphayeeeet commented 8 months ago

Still there are no separate values for each quantile (which should be available in my opinion, maybe configurable if it's optional)

We don't give direct values of quantiles. Although, if you would want to check the values you can see from the ".value" field of the metric and then by opening the event you can see the quantile it corresponds to Screenshot 2024-03-13 at 10 15 53 AM

@ishleenk17 This should be a basic feature in my opinion, that I can decide, which quantile metric to use (all of them should be present in the event). Still I do not even get the '.value' field as stated out above in my screenshots. There are no metrics of '*_blobstorefile...' present in my event. With this funcionality, the integration is not useable for our usecases...

ishleenk17 commented 8 months ago

@Alphayeeeet : Please share the stack and integration version you are using ?

Alphayeeeet commented 8 months ago

@ishleenk17 As stated out above, the stack version including the agents is 8.12.2.

Integration version: Tried with Prometheus Input v0.4.0 Also tried with Prometheus v1.15.0

Im happy to fully use the Prometheus Integration if it is fixed there.

Alphayeeeet commented 8 months ago

Is it possible to open a separate feature request for a configurable option to include the quantile values as distinct fields?

ishleenk17 commented 7 months ago

Is it possible to open a separate feature request for a configurable option to include the quantile values as distinct fields?

Yes, we can open a ticket. Although, I would first revisit the decision of showing these quantile values as part of a single field. I will keep you posted on this thread.

Alphayeeeet commented 6 months ago

@ishleenk17 Are there any updates by now?