kubernetes-sigs / usage-metrics-collector

High fidelity and scalable capacity and usage metrics for Kubernetes clusters
Apache License 2.0
123 stars 21 forks source link

[Flake] Timeout on TestMetricsNodeSamplerGRPC #10

Closed ehashman closed 1 year ago

ehashman commented 1 year ago

Looks like the test timed out...

{"level":"info","ts":1673568270.3090358,"logger":"usage-metrics-collector.kube-metrics-node-sampler","msg":"starting sampler"}
[109](https://prow.k8s.io/view/gs/kubernetes-jenkins/pr-logs/pull/kubernetes-sigs_usage-metrics-collector/7/pull-usage-metrics-collector-test/1613687860769067008#1:build-log.txt%3A109)
{"level":"info","ts":1673568270.41259,"logger":"usage-metrics-collector.kube-metrics-node-sampler","msg":"no cacheable results for cpu metrics","paths":["sys/fs/cgroup/cpu","sys/fs/cgroup/cpuacct"]}
[110](https://prow.k8s.io/view/gs/kubernetes-jenkins/pr-logs/pull/kubernetes-sigs_usage-metrics-collector/7/pull-usage-metrics-collector-test/1613687860769067008#1:build-log.txt%3A110)
    integration_test.go:173: 
[111](https://prow.k8s.io/view/gs/kubernetes-jenkins/pr-logs/pull/kubernetes-sigs_usage-metrics-collector/7/pull-usage-metrics-collector-test/1613687860769067008#1:build-log.txt%3A111)
            Error Trace:    integration_test.go:173
[112](https://prow.k8s.io/view/gs/kubernetes-jenkins/pr-logs/pull/kubernetes-sigs_usage-metrics-collector/7/pull-usage-metrics-collector-test/1613687860769067008#1:build-log.txt%3A112)
                                        testutil.go:118
[113](https://prow.k8s.io/view/gs/kubernetes-jenkins/pr-logs/pull/kubernetes-sigs_usage-metrics-collector/7/pull-usage-metrics-collector-test/1613687860769067008#1:build-log.txt%3A113)
            Error:          Condition never satisfied
[114](https://prow.k8s.io/view/gs/kubernetes-jenkins/pr-logs/pull/kubernetes-sigs_usage-metrics-collector/7/pull-usage-metrics-collector-test/1613687860769067008#1:build-log.txt%3A114)
            Test:           TestMetricsNodeSamplerGRPC/.
[115](https://prow.k8s.io/view/gs/kubernetes-jenkins/pr-logs/pull/kubernetes-sigs_usage-metrics-collector/7/pull-usage-metrics-collector-test/1613687860769067008#1:build-log.txt%3A115)
--- FAIL: TestMetricsNodeSamplerGRPC (10.08s)

See https://prow.k8s.io/view/gs/kubernetes-jenkins/pr-logs/pull/kubernetes-sigs_usage-metrics-collector/7/pull-usage-metrics-collector-test/1613687860769067008#1:build-log.txt%3A106-115

Might need a bump in resources on the job spec.

/kind flake

ehashman commented 1 year ago

/triage accepted

Should be fixed by either https://github.com/kubernetes/test-infra/pull/28441 which added requests/limits to the jobs or #12. Let's close and reopen if it keeps flaking.

/close

k8s-ci-robot commented 1 year ago

@ehashman: Closing this issue.

In response to [this](https://github.com/kubernetes-sigs/usage-metrics-collector/issues/10#issuecomment-1386236160): >/triage accepted > >Should be fixed by either https://github.com/kubernetes/test-infra/pull/28441 which added requests/limits to the jobs or #12. Let's close and reopen if it keeps flaking. > >/close Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.