search

OT-CONTAINER-KIT / helm-charts

A repository which that will contain helm charts with best and security practices.
https://ot-container-kit.github.io/helm-charts
49 stars 84 forks source link

Fix the performance issue of duration_milliseconds_bucket metrics #237

Open ashwani-opstree opened 2 months ago

ashwani-opstree commented 2 months ago

OpenTelemetry generate duration_milliseconds_bucket that is stored in the prometheus. It is taking time while fetching it from grafana.

Possible solutions

  1. Decrease the Number of Bins: Reduce the number of bins in the histogram, which will decrease the amount of data being tracked. This might slightly reduce the granularity but will significantly reduce the size.

  2. Increase the Bucket Size: By increasing the bucket size, you aggregate more data into fewer buckets, thus reducing the overall number of data points stored.