kubernetes-sigs / prometheus-adapter

An implementation of the custom.metrics.k8s.io API using Prometheus
Apache License 2.0
1.9k stars 551 forks source link

[bug] erroneous timeout #625

Open cornfeedhobo opened 9 months ago

cornfeedhobo commented 9 months ago

What happened?:

panic.go:838] "HTTP" verb="GET" URI="/apis/custom.metrics.k8s.io/v1beta1" latency="25.789098ms" userAgent="Go-http-client/2.0" audit-ID="bb032cb7-e6bd-4aee-8d52-3c8ac71d3987" srcIP="10.0.0.151:44714" resp=200
wrap.go:53] timeout or abort while handling: method=GET URI="/apis/custom.metrics.k8s.io/v1beta1" audit-ID="bb032cb7-e6bd-4aee-8d52-3c8ac71d3987"

What did you expect to happen?:

No log spam about a request that reports a successful response (200).

Anything else we need to know?:

Known workarounds?:

It is possible to set rules.default=false, which disables the baseline metrics instead of addressing the underlying issue.

Environment:

dgrisonnet commented 9 months ago

/triage accepted /assign

cornfeedhobo commented 9 months ago

I'll post some debug logs when I create another test cluster.

dgrisonnet commented 9 months ago

Which verbose level are you using?

cornfeedhobo commented 8 months ago

I'll do my best to revisit this, but unfortunately I had to move on to other things and don't know when I'll have capacity to bring up a test cluster again. I'm frankly running out of resources.