search

kubernetes / node-problem-detector

This is a place for various problem detectors running on the Kubernetes nodes.
Apache License 2.0
2.95k stars 627 forks source link

Node Problem Detector Test Failures #831

Closed kannon92 closed 11 months ago

kannon92 commented 12 months ago

Node Problem Detector tests in https://testgrid.k8s.io/sig-node-node-problem-detector#ci-npd-e2e-kubernetes-gce-gci have been failing for a few days now.

Oct 11 20:21:57.110667 e2e-a567c5c867-7abb6-minion-group-4l73 node-problem-detector[3358]: /home/kubernetes/bin/node-problem-detector: /lib64/libc.so.6: version `GLIBC_2.34' not found (required by /home/kubernetes/bin/node-problem-detector)
Oct 11 20:21:57.110776 e2e-a567c5c867-7abb6-minion-group-4l73 systemd[1]: node-problem-detector.service: Main process exited, code=exited, status=1/FAILURE
Oct 11 20:21:57.111005 e2e-a567c5c867-7abb6-minion-group-4l73 systemd[1]: node-problem-detector.service: Failed with result 'exit-code'.
Oct 11 20:22:07.351971 e2e-a567c5c867-7abb6-minion-group-4l73 systemd[1]: node-problem-detector.service: Scheduled restart job, restart counter is at 42.
Oct 11 20:22:07.352335 e2e-a567c5c867-7abb6-minion-group-4l73 systemd[1]: Stopped Kubernetes node problem detector.
Oct 11 20:22:07.359272 e2e-a567c5c867-7abb6-minion-group-4l73 systemd[1]: Started Kubernetes node problem detector.
Oct 11 20:22:07.360603 e2e-a567c5c867-7abb6-minion-group-4l73 systemd[1]: node-problem-detector.service: Main process exited, code=exited, status=1/FAILURE

It looks like there is an incompability with GLIBC_2.3.4.

This may require a bump to the COS version also.

kannon92 commented 12 months ago

/priority important-soon

kannon92 commented 12 months ago

Relevant PR for updating the COS in test-infra: https://github.com/kubernetes/test-infra/pull/31003#pullrequestreview-1669945893

hakman commented 11 months ago

Both periodic tests are now passing. Thanks @kannon92! /close

k8s-ci-robot commented 11 months ago

@hakman: Closing this issue.

In response to [this](https://github.com/kubernetes/node-problem-detector/issues/831#issuecomment-1789113285): >Both periodic tests are now passing. Thanks @kannon92! >/close Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.