keptn / lifecycle-toolkit

Toolkit for cloud-native application lifecycle management
https://keptn.sh
Apache License 2.0
267 stars 111 forks source link

Change the histogram buckets for keptn_deployment_duration_seconds_bucket #3563

Closed benmathews closed 1 day ago

benmathews commented 1 week ago

The lifecycle operator produces a prometheus histogram metric keptn_deployment_duration_seconds_bucket. The buckets though are inappropriate for tracking the duration of deployment roll-outs. I've got default buckets of 0, 5, 10, 25, 50, 75, 100, 250, 500, 750, 1000, 2500, 5000, 7500, 10000, and +Inf milliseconds. Only the top couple buckets are providing any value.

I don't see in the code or chart any way to modify these buckets. Am I missing something. Is is possible to add this configuration?

RealAnna commented 2 days ago

Hello @benmathews! These buckets are created directly in Grafana, you can modify your panel configuration to include only specific buckets using a different organize transformation than what we provide in it.

The default dashboard is available here