kubernetes / kube-state-metrics

Add-on agent to generate and expose cluster-level metrics.
https://kubernetes.io/docs/concepts/cluster-administration/kube-state-metrics/
Apache License 2.0
5.21k stars 1.93k forks source link

When collecting indicators kube_persistentvolume_info, it will fail #2260

Open gitlilei2019 opened 7 months ago

gitlilei2019 commented 7 months ago

when curl ip:8080/metrics,Execution will get stuck。then prometheus will down kube-state-metrics。 k8s version:1.22,kube-state-metrics version:2.4.2

image image

kube_persistentvolume_info

prometheus

CatherineF-dev commented 6 months ago

Hi, could you help provide detailed steps to reproduce this issue?

CatherineF-dev commented 6 months ago

Also, could you try latest KSM version to see whether it's still having this issue?

logicalhan commented 6 months ago

/triage accepted /assign @CatherineF-dev

CatherineF-dev commented 6 months ago

Ping~ Have you resolved the issue? cc @gitlilei2019

gitlilei2019 commented 6 months ago

Ping~ Have you resolved the issue? cc @gitlilei2019

use version 2.10.0 is ok

CatherineF-dev commented 6 months ago

Hi @gitlilei2019, could you help find which KSM version starts having this issue, if you're available? Thx

gitlilei2019 commented 6 months ago

Hi @gitlilei2019, could you help find which KSM version starts having this issue, if you're available? Thx

This problem is occasional, and sometimes curl ip: 8080/metrics may get stuck. But this problem has always existed, from version 2.4.2 to version 2.10.0, it was collected in "kube_persistentvolume_info" indicator will freeze for a few seconds, but it can still be executed in the end. kube_persistentvolume_info