search

kubernetes-retired / external-storage

[EOL] External storage plugins, provisioners, and helper libraries
Apache License 2.0
2.69k stars 1.6k forks source link

NFSD: client xxx.xxx.xxx.xxx testing state ID with incorrect client ID #1348

Closed on4tux closed 4 years ago

on4tux commented 4 years ago

I have a 2 worker node k8s cluster and a NAS running Ubuntu sid. I managed to setup nfs-client-provisioner and present it to my deployments. Although the volumes are mounted, the applications throw errors at runtime. On the NAS server, syslog is spammed with 'NFSD: client 10.0.0.47 testing state ID with incorrect client ID' errors. Everything works fine if I use the manual pv nfs mount (part 1 of https://medium.com/@myte/kubernetes-nfs-and-dynamic-nfs-provisioning-97e2afb8b4a9)

on worker 10.0.0.76; $ mount | grep nfs 10.0.0.47:/data/k8s/default-home-assistant-pvc-c43bea52-2426-4c34-9fe6-5a46f7e6ff1c on /var/lib/kubelet/pods/0d17f909-e116-4abe-8343-a2af68026364/volumes/kubernetes.io~nfs/pvc-c43bea52-2426-4c34-9fe6-5a46f7e6ff1c type nfs4 (rw,relatime,vers=4.2,rsize=262144,wsize=262144,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=10.0.0.76,local_lock=none,addr=10.0.0.47)

$ kubectl get nodes -o wide NAME STATUS ROLES AGE VERSION INTERNAL-IP EXTERNAL-IP OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME 10.0.0.48 Ready worker 142d v1.17.2 10.0.0.48 Ubuntu 18.04.4 LTS 4.15.0-106-generic docker://19.3.11 10.0.0.74 Ready controlplane,etcd 142d v1.17.2 10.0.0.74 Ubuntu 18.04.4 LTS 4.15.0-106-generic docker://19.3.11 10.0.0.76 Ready worker 142d v1.17.2 10.0.0.76 Ubuntu 18.04.4 LTS 4.15.0-106-generic docker://19.3.11

$ helm list | grep nfs nfs-client-provisioner2 default 1 2020-06-17 19:23:02.653471773 +0200 CEST deployed nfs-client-provisioner-1.2.8 3.1.0

on4tux commented 4 years ago

Solved: both nodes were provisioned from a template, without changing /etc/machine-id. I applied the solution from https://www.gitmemory.com/issue/systemd/systemd/13261/519024809.