search

kubernetes-sigs / kubespray

Deploy a Production Ready Kubernetes Cluster
Apache License 2.0
15.91k stars 6.42k forks source link

Kubespray 1.20 doesn't install docker as a container runtime #9555

Closed MuhendisBey closed 7 months ago

MuhendisBey commented 1 year ago

Environment:

Kubespray version (commit) (git rev-parse --short HEAD): c553912f9

Network plugin used: calico

Full inventory with variables (ansible -i inventory/sample/inventory.ini all -m debug -a "var=hostvars[inventory_hostname]"):

localhost

Command used to invoke ansible: ansible-playbook -i hosts_ubuntuJammy.yml cluster.yml -become --become-user root

I have changed container_manager from containerd to docker and i have changed etcd_deployment_type from host to docker.

Then I invoked the ansbile command but after succesfull installation, i saw the containerd v1.6.8 as a container runtime. Docker was not installed.

Any comment or known issue ?

Many thanks, With My Best Regards

kundan2707 commented 1 year ago

@MuhendisBey have you followed https://github.com/kubernetes-sigs/kubespray/blob/master/docs/docker.md related to version specific guideline??

MuhendisBey commented 1 year ago

Hello @kundan2707

Thx for quick response. I had a look at that link. I have noticed that only few things are different. one of them is docker_storage_options the other ones are docker_container_storage_setup and docker_container_storage_setup_devs Rest of the things are the same except insecure registries because i don't use internal private registries. Beside that, I'm using Ubuntu so that i don't need to enable docker_container_storage_setup and docker_container_storage_setup_devs options.

The one thing which is different, is "docker_storage_options: -s overlay". I'll try to install with like this. Then, I'll inform back.

Many thanks for the answer, Have a good day.

P.S: btw, all of changes are in the inventory/sample/group_vars/all/docker.yml. Is it correct file to change ?

k8s-triage-robot commented 1 year ago

The Kubernetes project currently lacks enough contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

You can:

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

kundan2707 commented 1 year ago

/remove-lifecycle stale

kundan2707 commented 1 year ago

@MuhendisBey Have you tried again ? if yes please share outcome.

Slawka commented 1 year ago

node: Ubuntu 22.04.2 LTS root@node1:~# uname -a Linux node1 5.15.0-69-generic #76-Ubuntu SMP Fri Mar 17 17:19:29 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Current master branch

FAILED - RETRYING: [node1]: Create kubeadm token for joining nodes with 24h expiration (default) (1 retries left).

TASK [kubernetes/control-plane : Create kubeadm token for joining nodes with 24h expiration (default)] *********************************************************************************************************************************
fatal: [node2 -> node1(10.20.31.51)]: FAILED! => {"attempts": 5, "changed": false, "cmd": ["/usr/local/bin/kubeadm", "--kubeconfig", "/etc/kubernetes/admin.conf", "token", "create"], "delta": "0:01:15.094643", "end": "2023-04-08 19:24:17.010670", "msg": "non-zero return code", "rc": 1, "start": "2023-04-08 19:23:01.916027", "stderr": "timed out waiting for the condition\nTo see the stack trace of this error execute with --v=5 or higher", "stderr_lines": ["timed out waiting for the condition", "To see the stack trace of this error execute with --v=5 or higher"], "stdout": "", "stdout_lines": []}
fatal: [node1]: FAILED! => {"attempts": 5, "changed": false, "cmd": ["/usr/local/bin/kubeadm", "--kubeconfig", "/etc/kubernetes/admin.conf", "token", "create"], "delta": "0:01:15.114481", "end": "2023-04-08 19:24:17.028796", "msg": "non-zero return code", "rc": 1, "start": "2023-04-08 19:23:01.914315", "stderr": "timed out waiting for the condition\nTo see the stack trace of this error execute with --v=5 or higher", "stderr_lines": ["timed out waiting for the condition", "To see the stack trace of this error execute with --v=5 or higher"], "stdout": "", "stdout_lines": []}

On node 


root@node1:~# /usr/bin/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --kubeconfig=/etc/kubernetes/kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/containerd/containerd.sock --pod-infra-container-image=registry.k8s.io/pause:3.9 -v=999
I0408 17:30:50.567080  126727 flags.go:59] FLAG: --add-dir-header="false"
I0408 17:30:50.567981  126727 flags.go:59] FLAG: --address="0.0.0.0"
I0408 17:30:50.568612  126727 flags.go:59] FLAG: --allowed-unsafe-sysctls="[]"
I0408 17:30:50.569236  126727 flags.go:59] FLAG: --alsologtostderr="false"
I0408 17:30:50.569833  126727 flags.go:59] FLAG: --anonymous-auth="true"
I0408 17:30:50.570471  126727 flags.go:59] FLAG: --application-metrics-count-limit="100"
I0408 17:30:50.570647  126727 flags.go:59] FLAG: --authentication-token-webhook="false"
I0408 17:30:50.570791  126727 flags.go:59] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
I0408 17:30:50.570921  126727 flags.go:59] FLAG: --authorization-mode="AlwaysAllow"
I0408 17:30:50.571059  126727 flags.go:59] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
I0408 17:30:50.571178  126727 flags.go:59] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
I0408 17:30:50.571294  126727 flags.go:59] FLAG: --azure-container-registry-config=""
I0408 17:30:50.571411  126727 flags.go:59] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
I0408 17:30:50.571534  126727 flags.go:59] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/bootstrap-kubelet.conf"
I0408 17:30:50.571652  126727 flags.go:59] FLAG: --cert-dir="/var/lib/kubelet/pki"
I0408 17:30:50.571818  126727 flags.go:59] FLAG: --cgroup-driver="cgroupfs"
I0408 17:30:50.571951  126727 flags.go:59] FLAG: --cgroup-root=""
I0408 17:30:50.572090  126727 flags.go:59] FLAG: --cgroups-per-qos="true"
I0408 17:30:50.572213  126727 flags.go:59] FLAG: --client-ca-file=""
I0408 17:30:50.572336  126727 flags.go:59] FLAG: --cloud-config=""
I0408 17:30:50.573316  126727 flags.go:59] FLAG: --cloud-provider=""
I0408 17:30:50.573910  126727 flags.go:59] FLAG: --cluster-dns="[]"
I0408 17:30:50.574541  126727 flags.go:59] FLAG: --cluster-domain=""
I0408 17:30:50.575208  126727 flags.go:59] FLAG: --cni-bin-dir="/opt/cni/bin"
I0408 17:30:50.575657  126727 flags.go:59] FLAG: --cni-cache-dir="/var/lib/cni/cache"
I0408 17:30:50.576038  126727 flags.go:59] FLAG: --cni-conf-dir="/etc/cni/net.d"
I0408 17:30:50.576080  126727 flags.go:59] FLAG: --config="/var/lib/kubelet/config.yaml"
I0408 17:30:50.576104  126727 flags.go:59] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
I0408 17:30:50.576141  126727 flags.go:59] FLAG: --container-log-max-files="5"
I0408 17:30:50.576169  126727 flags.go:59] FLAG: --container-log-max-size="10Mi"
I0408 17:30:50.576193  126727 flags.go:59] FLAG: --container-runtime="docker"
I0408 17:30:50.576216  126727 flags.go:59] FLAG: --container-runtime-endpoint="unix:///var/run/containerd/containerd.sock"
I0408 17:30:50.576241  126727 flags.go:59] FLAG: --containerd="/run/containerd/containerd.sock"
I0408 17:30:50.576264  126727 flags.go:59] FLAG: --containerd-namespace="k8s.io"
I0408 17:30:50.576828  126727 flags.go:59] FLAG: --contention-profiling="false"
I0408 17:30:50.576869  126727 flags.go:59] FLAG: --cpu-cfs-quota="true"
I0408 17:30:50.576895  126727 flags.go:59] FLAG: --cpu-cfs-quota-period="100ms"
I0408 17:30:50.576919  126727 flags.go:59] FLAG: --cpu-manager-policy="none"
I0408 17:30:50.576955  126727 flags.go:59] FLAG: --cpu-manager-policy-options=""
I0408 17:30:50.576981  126727 flags.go:59] FLAG: --cpu-manager-reconcile-period="10s"
I0408 17:30:50.577018  126727 flags.go:59] FLAG: --docker="unix:///var/run/docker.sock"
I0408 17:30:50.577042  126727 flags.go:59] FLAG: --docker-endpoint="unix:///var/run/docker.sock"
I0408 17:30:50.577079  126727 flags.go:59] FLAG: --docker-env-metadata-whitelist=""
I0408 17:30:50.577104  126727 flags.go:59] FLAG: --docker-only="false"
I0408 17:30:50.577128  126727 flags.go:59] FLAG: --docker-root="/var/lib/docker"
I0408 17:30:50.577152  126727 flags.go:59] FLAG: --docker-tls="false"
I0408 17:30:50.577175  126727 flags.go:59] FLAG: --docker-tls-ca="ca.pem"
I0408 17:30:50.577199  126727 flags.go:59] FLAG: --docker-tls-cert="cert.pem"
I0408 17:30:50.577239  126727 flags.go:59] FLAG: --docker-tls-key="key.pem"
I0408 17:30:50.577264  126727 flags.go:59] FLAG: --dynamic-config-dir=""
I0408 17:30:50.577290  126727 flags.go:59] FLAG: --enable-controller-attach-detach="true"
I0408 17:30:50.577314  126727 flags.go:59] FLAG: --enable-debugging-handlers="true"
I0408 17:30:50.577347  126727 flags.go:59] FLAG: --enable-load-reader="false"
I0408 17:30:50.577372  126727 flags.go:59] FLAG: --enable-server="true"
I0408 17:30:50.577408  126727 flags.go:59] FLAG: --enforce-node-allocatable="[pods]"
I0408 17:30:50.577442  126727 flags.go:59] FLAG: --event-burst="10"
I0408 17:30:50.577467  126727 flags.go:59] FLAG: --event-qps="5"
I0408 17:30:50.577489  126727 flags.go:59] FLAG: --event-storage-age-limit="default=0"
I0408 17:30:50.577512  126727 flags.go:59] FLAG: --event-storage-event-limit="default=0"
I0408 17:30:50.577535  126727 flags.go:59] FLAG: --eviction-hard="imagefs.available<15%,memory.available<100Mi,nodefs.available<10%,nodefs.inodesFree<5%"
I0408 17:30:50.577573  126727 flags.go:59] FLAG: --eviction-max-pod-grace-period="0"
I0408 17:30:50.577596  126727 flags.go:59] FLAG: --eviction-minimum-reclaim=""
I0408 17:30:50.577754  126727 flags.go:59] FLAG: --eviction-pressure-transition-period="5m0s"
I0408 17:30:50.577989  126727 flags.go:59] FLAG: --eviction-soft=""
I0408 17:30:50.578503  126727 flags.go:59] FLAG: --eviction-soft-grace-period=""
I0408 17:30:50.578531  126727 flags.go:59] FLAG: --exit-on-lock-contention="false"
I0408 17:30:50.578569  126727 flags.go:59] FLAG: --experimental-allocatable-ignore-eviction="false"
I0408 17:30:50.578592  126727 flags.go:59] FLAG: --experimental-bootstrap-kubeconfig="/etc/kubernetes/bootstrap-kubelet.conf"
I0408 17:30:50.578630  126727 flags.go:59] FLAG: --experimental-check-node-capabilities-before-mount="false"
I0408 17:30:50.578653  126727 flags.go:59] FLAG: --experimental-dockershim-root-directory="/var/lib/dockershim"
I0408 17:30:50.579157  126727 flags.go:59] FLAG: --experimental-kernel-memcg-notification="false"
I0408 17:30:50.579204  126727 flags.go:59] FLAG: --experimental-logging-sanitization="false"
I0408 17:30:50.579248  126727 flags.go:59] FLAG: --experimental-mounter-path=""
I0408 17:30:50.580093  126727 flags.go:59] FLAG: --fail-swap-on="true"
I0408 17:30:50.580154  126727 flags.go:59] FLAG: --feature-gates=""
I0408 17:30:50.580195  126727 flags.go:59] FLAG: --file-check-frequency="20s"
I0408 17:30:50.580222  126727 flags.go:59] FLAG: --global-housekeeping-interval="1m0s"
I0408 17:30:50.580620  126727 flags.go:59] FLAG: --hairpin-mode="promiscuous-bridge"
I0408 17:30:50.580654  126727 flags.go:59] FLAG: --healthz-bind-address="127.0.0.1"
I0408 17:30:50.580679  126727 flags.go:59] FLAG: --healthz-port="10248"
I0408 17:30:50.580703  126727 flags.go:59] FLAG: --help="false"
I0408 17:30:50.580727  126727 flags.go:59] FLAG: --hostname-override=""
I0408 17:30:50.580960  126727 flags.go:59] FLAG: --housekeeping-interval="10s"
I0408 17:30:50.581297  126727 flags.go:59] FLAG: --http-check-frequency="20s"
I0408 17:30:50.581351  126727 flags.go:59] FLAG: --image-credential-provider-bin-dir=""
I0408 17:30:50.581376  126727 flags.go:59] FLAG: --image-credential-provider-config=""
I0408 17:30:50.581413  126727 flags.go:59] FLAG: --image-gc-high-threshold="85"
I0408 17:30:50.581437  126727 flags.go:59] FLAG: --image-gc-low-threshold="80"
I0408 17:30:50.581847  126727 flags.go:59] FLAG: --image-pull-progress-deadline="1m0s"
I0408 17:30:50.581880  126727 flags.go:59] FLAG: --image-service-endpoint=""
I0408 17:30:50.581904  126727 flags.go:59] FLAG: --iptables-drop-bit="15"
I0408 17:30:50.581941  126727 flags.go:59] FLAG: --iptables-masquerade-bit="14"
I0408 17:30:50.581964  126727 flags.go:59] FLAG: --keep-terminated-pod-volumes="false"
I0408 17:30:50.582448  126727 flags.go:59] FLAG: --kernel-memcg-notification="false"
I0408 17:30:50.582606  126727 flags.go:59] FLAG: --kube-api-burst="10"
I0408 17:30:50.582654  126727 flags.go:59] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
I0408 17:30:50.583001  126727 flags.go:59] FLAG: --kube-api-qps="5"
I0408 17:30:50.583044  126727 flags.go:59] FLAG: --kube-reserved=""
I0408 17:30:50.583072  126727 flags.go:59] FLAG: --kube-reserved-cgroup=""
I0408 17:30:50.583095  126727 flags.go:59] FLAG: --kubeconfig="/etc/kubernetes/kubelet.conf"
I0408 17:30:50.583653  126727 flags.go:59] FLAG: --kubelet-cgroups=""
I0408 17:30:50.583701  126727 flags.go:59] FLAG: --lock-file=""
I0408 17:30:50.583727  126727 flags.go:59] FLAG: --log-backtrace-at=":0"
I0408 17:30:50.583779  126727 flags.go:59] FLAG: --log-cadvisor-usage="false"
I0408 17:30:50.583806  126727 flags.go:59] FLAG: --log-dir=""
I0408 17:30:50.584401  126727 flags.go:59] FLAG: --log-file=""
I0408 17:30:50.584443  126727 flags.go:59] FLAG: --log-file-max-size="1800"
I0408 17:30:50.584469  126727 flags.go:59] FLAG: --log-flush-frequency="5s"
I0408 17:30:50.584493  126727 flags.go:59] FLAG: --logging-format="text"
I0408 17:30:50.584517  126727 flags.go:59] FLAG: --logtostderr="true"
I0408 17:30:50.584540  126727 flags.go:59] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
I0408 17:30:50.584878  126727 flags.go:59] FLAG: --make-iptables-util-chains="true"
I0408 17:30:50.584924  126727 flags.go:59] FLAG: --manifest-url=""
I0408 17:30:50.584956  126727 flags.go:59] FLAG: --manifest-url-header=""
I0408 17:30:50.585343  126727 flags.go:59] FLAG: --master-service-namespace="default"
I0408 17:30:50.585409  126727 flags.go:59] FLAG: --max-open-files="1000000"
I0408 17:30:50.585438  126727 flags.go:59] FLAG: --max-pods="110"
I0408 17:30:50.585476  126727 flags.go:59] FLAG: --maximum-dead-containers="-1"
I0408 17:30:50.585500  126727 flags.go:59] FLAG: --maximum-dead-containers-per-container="1"
I0408 17:30:50.586017  126727 flags.go:59] FLAG: --memory-manager-policy="None"
I0408 17:30:50.586093  126727 flags.go:59] FLAG: --minimum-container-ttl-duration="0s"
I0408 17:30:50.586122  126727 flags.go:59] FLAG: --minimum-image-ttl-duration="2m0s"
I0408 17:30:50.586146  126727 flags.go:59] FLAG: --network-plugin=""
I0408 17:30:50.586170  126727 flags.go:59] FLAG: --network-plugin-mtu="0"
I0408 17:30:50.586193  126727 flags.go:59] FLAG: --node-ip=""
I0408 17:30:50.586703  126727 flags.go:59] FLAG: --node-labels=""
I0408 17:30:50.586733  126727 flags.go:59] FLAG: --node-status-max-images="50"
I0408 17:30:50.586758  126727 flags.go:59] FLAG: --node-status-update-frequency="10s"
I0408 17:30:50.586782  126727 flags.go:59] FLAG: --non-masquerade-cidr="10.0.0.0/8"
I0408 17:30:50.587110  126727 flags.go:59] FLAG: --one-output="false"
I0408 17:30:50.587322  126727 flags.go:59] FLAG: --oom-score-adj="-999"
I0408 17:30:50.587358  126727 flags.go:59] FLAG: --pod-cidr=""
I0408 17:30:50.587729  126727 flags.go:59] FLAG: --pod-infra-container-image="registry.k8s.io/pause:3.9"
I0408 17:30:50.588035  126727 flags.go:59] FLAG: --pod-manifest-path=""
I0408 17:30:50.588062  126727 flags.go:59] FLAG: --pod-max-pids="-1"
I0408 17:30:50.588088  126727 flags.go:59] FLAG: --pods-per-core="0"
I0408 17:30:50.588112  126727 flags.go:59] FLAG: --port="10250"
I0408 17:30:50.588136  126727 flags.go:59] FLAG: --protect-kernel-defaults="false"
I0408 17:30:50.588503  126727 flags.go:59] FLAG: --provider-id=""
I0408 17:30:50.588533  126727 flags.go:59] FLAG: --qos-reserved=""
I0408 17:30:50.588559  126727 flags.go:59] FLAG: --read-only-port="10255"
I0408 17:30:50.588583  126727 flags.go:59] FLAG: --really-crash-for-testing="false"
I0408 17:30:50.589323  126727 flags.go:59] FLAG: --register-node="true"
I0408 17:30:50.589382  126727 flags.go:59] FLAG: --register-schedulable="true"
I0408 17:30:50.589413  126727 flags.go:59] FLAG: --register-with-taints=""
I0408 17:30:50.589440  126727 flags.go:59] FLAG: --registry-burst="10"
I0408 17:30:50.589464  126727 flags.go:59] FLAG: --registry-qps="5"
I0408 17:30:50.589966  126727 flags.go:59] FLAG: --reserved-cpus=""
I0408 17:30:50.590013  126727 flags.go:59] FLAG: --reserved-memory=""
I0408 17:30:50.590052  126727 flags.go:59] FLAG: --resolv-conf="/etc/resolv.conf"
I0408 17:30:50.590966  126727 flags.go:59] FLAG: --root-dir="/var/lib/kubelet"
I0408 17:30:50.591046  126727 flags.go:59] FLAG: --rotate-certificates="false"
I0408 17:30:50.591081  126727 flags.go:59] FLAG: --rotate-server-certificates="false"
I0408 17:30:50.591106  126727 flags.go:59] FLAG: --runonce="false"
I0408 17:30:50.591130  126727 flags.go:59] FLAG: --runtime-cgroups=""
I0408 17:30:50.591153  126727 flags.go:59] FLAG: --runtime-request-timeout="2m0s"
I0408 17:30:50.591178  126727 flags.go:59] FLAG: --seccomp-default="false"
I0408 17:30:50.591201  126727 flags.go:59] FLAG: --seccomp-profile-root="/var/lib/kubelet/seccomp"
I0408 17:30:50.591225  126727 flags.go:59] FLAG: --serialize-image-pulls="true"
I0408 17:30:50.591731  126727 flags.go:59] FLAG: --skip-headers="false"
I0408 17:30:50.591793  126727 flags.go:59] FLAG: --skip-log-headers="false"
I0408 17:30:50.591828  126727 flags.go:59] FLAG: --stderrthreshold="2"
I0408 17:30:50.592018  126727 flags.go:59] FLAG: --storage-driver-buffer-duration="1m0s"
I0408 17:30:50.592229  126727 flags.go:59] FLAG: --storage-driver-db="cadvisor"
I0408 17:30:50.592257  126727 flags.go:59] FLAG: --storage-driver-host="localhost:8086"
I0408 17:30:50.592281  126727 flags.go:59] FLAG: --storage-driver-password="root"
I0408 17:30:50.592304  126727 flags.go:59] FLAG: --storage-driver-secure="false"
I0408 17:30:50.592327  126727 flags.go:59] FLAG: --storage-driver-table="stats"
I0408 17:30:50.592508  126727 flags.go:59] FLAG: --storage-driver-user="root"
I0408 17:30:50.593124  126727 flags.go:59] FLAG: --streaming-connection-idle-timeout="4h0m0s"
I0408 17:30:50.593289  126727 flags.go:59] FLAG: --sync-frequency="1m0s"
I0408 17:30:50.593334  126727 flags.go:59] FLAG: --system-cgroups=""
I0408 17:30:50.593362  126727 flags.go:59] FLAG: --system-reserved=""
I0408 17:30:50.593387  126727 flags.go:59] FLAG: --system-reserved-cgroup=""
I0408 17:30:50.593703  126727 flags.go:59] FLAG: --tls-cert-file=""
I0408 17:30:50.593748  126727 flags.go:59] FLAG: --tls-cipher-suites="[]"
I0408 17:30:50.593781  126727 flags.go:59] FLAG: --tls-min-version=""
I0408 17:30:50.593964  126727 flags.go:59] FLAG: --tls-private-key-file=""
I0408 17:30:50.594129  126727 flags.go:59] FLAG: --topology-manager-policy="none"
I0408 17:30:50.594172  126727 flags.go:59] FLAG: --topology-manager-scope="container"
I0408 17:30:50.594198  126727 flags.go:59] FLAG: --v="999"
I0408 17:30:50.594222  126727 flags.go:59] FLAG: --version="false"
I0408 17:30:50.594853  126727 flags.go:59] FLAG: --vmodule=""
I0408 17:30:50.594896  126727 flags.go:59] FLAG: --volume-plugin-dir="/usr/libexec/kubernetes/kubelet-plugins/volume/exec/"
I0408 17:30:50.594922  126727 flags.go:59] FLAG: --volume-stats-agg-period="1m0s"
I0408 17:30:50.594997  126727 feature_gate.go:245] feature gates: &{map[]}
I0408 17:30:50.598449  126727 codec.go:118] "Using lenient decoding as strict decoding failed" err="strict decoder error for apiVersion: kubelet.config.k8s.io/v1beta1\nauthentication:\n  anonymous:\n    enabled: false\n  webhook:\n    cacheTTL: 0s\n    enabled: true\n  x509:\n    clientCAFile: /etc/kubernetes/ssl/ca.crt\nauthorization:\n  mode: Webhook\n  webhook:\n    cacheAuthorizedTTL: 0s\n    cacheUnauthorizedTTL: 0s\ncgroupDriver: systemd\nclusterDNS:\n- 169.254.25.10\nclusterDomain: cluster.local\ncpuManagerReconcilePeriod: 0s\nevictionPressureTransitionPeriod: 0s\nfileCheckFrequency: 0s\nhealthzBindAddress: 127.0.0.1\nhealthzPort: 10248\nhttpCheckFrequency: 0s\nimageMinimumGCAge: 0s\nkind: KubeletConfiguration\nlogging:\n  flushFrequency: 0\n  options:\n    json:\n      infoBufferSize: \"0\"\n  verbosity: 0\nmemorySwap: {}\nnodeStatusReportFrequency: 0s\nnodeStatusUpdateFrequency: 0s\nresolvConf: /run/systemd/resolve/resolv.conf\nrotateCertificates: true\nruntimeRequestTimeout: 0s\nshutdownGracePeriod: 0s\nshutdownGracePeriodCriticalPods: 0s\nstaticPodPath: /etc/kubernetes/manifests\nstreamingConnectionIdleTimeout: 0s\nsyncFrequency: 0s\nvolumeStatsAggPeriod: 0s\n: v1beta1.KubeletConfiguration.Logging: v1alpha1.LoggingConfiguration.ReadObject: found unknown field: flushFrequency, error found in #10 byte of ...|Frequency\":0,\"option|..., bigger context ...|\"KubeletConfiguration\",\"logging\":{\"flushFrequency\":0,\"options\":{\"json\":{\"infoBufferSize\":\"0\"}},\"verb|..."
I0408 17:30:50.599329  126727 feature_gate.go:245] feature gates: &{map[]}
I0408 17:30:50.599488  126727 feature_gate.go:245] feature gates: &{map[]}
I0408 17:30:50.629386  126727 mount_linux.go:211] Detected OS with systemd
I0408 17:30:50.629999  126727 server.go:290] "KubeletConfiguration" configuration={TypeMeta:{Kind: APIVersion:} EnableServer:true StaticPodPath:/etc/kubernetes/manifests SyncFrequency:{Duration:1m0s} FileCheckFrequency:{Duration:20s} HTTPCheckFrequency:{Duration:20s} StaticPodURL: StaticPodURLHeader:map[] Address:0.0.0.0 Port:10250 ReadOnlyPort:0 VolumePluginDir:/usr/libexec/kubernetes/kubelet-plugins/volume/exec/ ProviderID: TLSCertFile:/var/lib/kubelet/pki/kubelet.crt TLSPrivateKeyFile:/var/lib/kubelet/pki/kubelet.key TLSCipherSuites:[] TLSMinVersion: RotateCertificates:true ServerTLSBootstrap:false Authentication:{X509:{ClientCAFile:/etc/kubernetes/ssl/ca.crt} Webhook:{Enabled:true CacheTTL:{Duration:2m0s}} Anonymous:{Enabled:false}} Authorization:{Mode:Webhook Webhook:{CacheAuthorizedTTL:{Duration:5m0s} CacheUnauthorizedTTL:{Duration:30s}}} RegistryPullQPS:5 RegistryBurst:10 EventRecordQPS:5 EventBurst:10 EnableDebuggingHandlers:true EnableContentionProfiling:false HealthzPort:10248 HealthzBindAddress:127.0.0.1 OOMScoreAdj:-999 ClusterDomain:cluster.local ClusterDNS:[169.254.25.10] StreamingConnectionIdleTimeout:{Duration:4h0m0s} NodeStatusUpdateFrequency:{Duration:10s} NodeStatusReportFrequency:{Duration:5m0s} NodeLeaseDurationSeconds:40 ImageMinimumGCAge:{Duration:2m0s} ImageGCHighThresholdPercent:85 ImageGCLowThresholdPercent:80 VolumeStatsAggPeriod:{Duration:1m0s} KubeletCgroups: SystemCgroups: CgroupRoot: CgroupsPerQOS:true CgroupDriver:systemd CPUManagerPolicy:none CPUManagerPolicyOptions:map[] CPUManagerReconcilePeriod:{Duration:10s} MemoryManagerPolicy:None TopologyManagerPolicy:none TopologyManagerScope:container QOSReserved:map[] RuntimeRequestTimeout:{Duration:2m0s} HairpinMode:promiscuous-bridge MaxPods:110 PodCIDR: PodPidsLimit:-1 ResolverConfig:/run/systemd/resolve/resolv.conf RunOnce:false CPUCFSQuota:true CPUCFSQuotaPeriod:{Duration:100ms} MaxOpenFiles:1000000 NodeStatusMaxImages:50 ContentType:application/vnd.kubernetes.protobuf KubeAPIQPS:5 KubeAPIBurst:10 SerializeImagePulls:true EvictionHard:map[imagefs.available:15% memory.available:100Mi nodefs.available:10% nodefs.inodesFree:5%] EvictionSoft:map[] EvictionSoftGracePeriod:map[] EvictionPressureTransitionPeriod:{Duration:5m0s} EvictionMaxPodGracePeriod:0 EvictionMinimumReclaim:map[] PodsPerCore:0 EnableControllerAttachDetach:true ProtectKernelDefaults:false MakeIPTablesUtilChains:true IPTablesMasqueradeBit:14 IPTablesDropBit:15 FeatureGates:map[] FailSwapOn:true MemorySwap:{SwapBehavior:} ContainerLogMaxSize:10Mi ContainerLogMaxFiles:5 ConfigMapAndSecretChangeDetectionStrategy:Watch AllowedUnsafeSysctls:[] KernelMemcgNotification:false SystemReserved:map[] KubeReserved:map[] SystemReservedCgroup: KubeReservedCgroup: EnforceNodeAllocatable:[pods] ReservedSystemCPUs: ShowHiddenMetricsForVersion: Logging:{Format:text Sanitization:false} EnableSystemLogHandler:true ShutdownGracePeriod:{Duration:0s} ShutdownGracePeriodCriticalPods:{Duration:0s} ReservedMemory:[] EnableProfilingHandler:true EnableDebugFlagsHandler:true SeccompDefault:false MemoryThrottlingFactor:0xc00040b330}
I0408 17:30:50.630060  126727 server.go:440] "Kubelet version" kubeletVersion="v1.22.4"
I0408 17:30:50.630163  126727 feature_gate.go:245] feature gates: &{map[]}
I0408 17:30:50.630266  126727 feature_gate.go:245] feature gates: &{map[]}
I0408 17:30:50.630480  126727 server.go:868] "Client rotation is on, will bootstrap in background"
I0408 17:30:50.631928  126727 loader.go:372] Config loaded from file:  /etc/kubernetes/kubelet.conf
I0408 17:30:50.633007  126727 loader.go:372] Config loaded from file:  /etc/kubernetes/kubelet.conf
I0408 17:30:50.633249  126727 bootstrap.go:84] "Current kubeconfig file contents are still valid, no bootstrap necessary"
I0408 17:30:50.633373  126727 certificate_store.go:130] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-client-current.pem".
I0408 17:30:50.633842  126727 server.go:912] "Starting client certificate rotation"
I0408 17:30:50.633878  126727 certificate_manager.go:270] kubernetes.io/kube-apiserver-client-kubelet: Certificate rotation is enabled
I0408 17:30:50.634592  126727 certificate_manager.go:270] kubernetes.io/kube-apiserver-client-kubelet: Certificate expiration is 2024-04-04 19:28:46 +0000 UTC, rotation deadline is 2024-01-22 01:44:17.87745151 +0000 UTC
I0408 17:30:50.634692  126727 certificate_manager.go:270] kubernetes.io/kube-apiserver-client-kubelet: Waiting 6920h13m27.242774584s for next certificate rotation
I0408 17:30:50.634963  126727 dynamic_cafile_content.go:117] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/ssl/ca.crt"
I0408 17:30:50.635304  126727 dynamic_cafile_content.go:155] "Starting controller" name="client-ca-bundle::/etc/kubernetes/ssl/ca.crt"
W0408 17:30:50.638656  126727 manager.go:159] Cannot detect current cgroup on cgroup v2
I0408 17:30:50.639183  126727 plugin.go:68] Docker not connected: Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
I0408 17:30:55.643689  126727 plugin.go:40] CRI-O not connected: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory
I0408 17:30:55.644108  126727 fs.go:131] Filesystem UUIDs: map[2022-08-09-16-48-33-00:/dev/sr0 6608565f-a046-452a-b659-2faac2298ab2:/dev/sda2 7b298d5c-62f1-4f00-9ffd-f51f23b438db:/dev/dm-0]
I0408 17:30:55.644154  126727 fs.go:132] Filesystem partitions: map[/dev/mapper/ubuntu--vg-ubuntu--lv:{mountpoint:/ major:253 minor:0 fsType:ext4 blockSize:0} /dev/sda2:{mountpoint:/boot major:8 minor:2 fsType:ext4 blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:27 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:25 fsType:tmpfs blockSize:0} /run/lock:{mountpoint:/run/lock major:0 minor:28 fsType:tmpfs blockSize:0} /run/user/0:{mountpoint:/run/user/0 major:0 minor:43 fsType:tmpfs blockSize:0}]
I0408 17:30:55.644240  126727 nvidia.go:54] NVIDIA GPU metrics disabled
I0408 17:30:55.648503  126727 manager.go:213] Machine: {Timestamp:2023-04-08 17:30:55.648297707 +0000 UTC m=+5.163615763 NumCores:2 NumPhysicalCores:1 NumSockets:2 CpuFrequency:2194902 MemoryCapacity:4114563072 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:2048 NumPages:0}] MachineID:430c1d2af61745919178ccb3e10be4a9 SystemUUID:6626d478-3d08-4019-a26d-b39b3d66fa41 BootID:f0484e13-e030-4905-8e75-f0958d30002f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:27 Capacity:2057281536 Type:vfs Inodes:502266 HasInodes:true} {Device:/run/lock DeviceMajor:0 DeviceMinor:28 Capacity:5242880 Type:vfs Inodes:502266 HasInodes:true} {Device:/dev/sda2 DeviceMajor:8 DeviceMinor:2 Capacity:2040373248 Type:vfs Inodes:131072 HasInodes:true} {Device:/run/user/0 DeviceMajor:0 DeviceMinor:43 Capacity:411455488 Type:vfs Inodes:100453 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:25 Capacity:411459584 Type:vfs Inodes:502266 HasInodes:true} {Device:/dev/mapper/ubuntu--vg-ubuntu--lv DeviceMajor:253 DeviceMinor:0 Capacity:15740116992 Type:vfs Inodes:983040 HasInodes:true}] DiskMap:map[253:0:{Name:dm-0 Major:253 Minor:0 Size:16101933056 Scheduler:none} 8:0:{Name:sda Major:8 Minor:0 Size:34359738368 Scheduler:none}] NetworkDevices:[{Name:ens18 MacAddress:72:08:1a:40:a8:a0 Speed:1000 Mtu:1500}] Topology:[{Id:0 Memory:4114563072 HugePages:[{PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:4194304 Type:Unified Level:2} {Size:16777216 Type:Unified Level:3}] SocketID:0} {Id:0 Threads:[1] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:4194304 Type:Unified Level:2} {Size:16777216 Type:Unified Level:3}] SocketID:1}] Caches:[]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
I0408 17:30:55.648660  126727 manager_no_libpfm.go:28] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
I0408 17:30:55.649183  126727 manager.go:229] Version: {KernelVersion:5.15.0-69-generic ContainerOsVersion:Ubuntu 22.04.2 LTS DockerVersion:Unknown DockerAPIVersion:Unknown CadvisorVersion: CadvisorRevision:}
I0408 17:30:55.649345  126727 server.go:485] "Sending events to api server"
I0408 17:30:55.649409  126727 server.go:687] "--cgroups-per-qos enabled, but --cgroup-root was not specified.  defaulting to /"
I0408 17:30:55.649792  126727 container_manager_linux.go:280] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
I0408 17:30:55.649887  126727 container_manager_linux.go:285] "Creating Container Manager object based on Node Config" nodeConfig={RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:docker CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:systemd KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: ReservedSystemCPUs: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[{Signal:memory.available Operator:LessThan Value:{Quantity:100Mi Percentage:0} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.1} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.inodesFree Operator:LessThan Value:{Quantity:<nil> Percentage:0.05} GracePeriod:0s MinReclaim:<nil>} {Signal:imagefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.15} GracePeriod:0s MinReclaim:<nil>}]} QOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalCPUManagerPolicyOptions:map[] ExperimentalTopologyManagerScope:container ExperimentalCPUManagerReconcilePeriod:10s ExperimentalMemoryManagerPolicy:None ExperimentalMemoryManagerReservedMemory:[] ExperimentalPodPidsLimit:-1 EnforceCPULimits:true CPUCFSQuotaPeriod:100ms ExperimentalTopologyManagerPolicy:none}
I0408 17:30:55.649949  126727 topology_manager.go:133] "Creating topology manager with policy per scope" topologyPolicyName="none" topologyScopeName="container"
I0408 17:30:55.649981  126727 container_manager_linux.go:320] "Creating device plugin manager" devicePluginEnabled=true
I0408 17:30:55.650044  126727 manager.go:139] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
I0408 17:30:55.650087  126727 state_mem.go:36] "Initialized new in-memory state store"
I0408 17:30:55.650126  126727 oom_linux.go:65] attempting to set "/proc/self/oom_score_adj" to "-999"
I0408 17:30:55.650203  126727 kubelet.go:314] "Using dockershim is deprecated, please consider using a full-fledged CRI implementation"
I0408 17:30:55.650254  126727 client.go:78] "Connecting to docker on the dockerEndpoint" endpoint="unix:///var/run/docker.sock"
I0408 17:30:55.651282  126727 client.go:97] "Start docker client with request timeout" timeout="2m0s"
E0408 17:30:55.652245  126727 server.go:294] "Failed to run kubelet" err="failed to run Kubelet: failed to get docker version: Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?"```
k8s-triage-robot commented 1 year ago

The Kubernetes project currently lacks enough contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

You can:

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

k8s-triage-robot commented 8 months ago

The Kubernetes project currently lacks enough active contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

You can:

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle rotten

k8s-triage-robot commented 7 months ago

The Kubernetes project currently lacks enough active contributors to adequately respond to all issues and PRs.

This bot triages issues according to the following rules:

You can:

Please send feedback to sig-contributor-experience at kubernetes/community.

/close not-planned

k8s-ci-robot commented 7 months ago

@k8s-triage-robot: Closing this issue, marking it as "Not Planned".

In response to [this](https://github.com/kubernetes-sigs/kubespray/issues/9555#issuecomment-1951350319): >The Kubernetes project currently lacks enough active contributors to adequately respond to all issues and PRs. > >This bot triages issues according to the following rules: >- After 90d of inactivity, `lifecycle/stale` is applied >- After 30d of inactivity since `lifecycle/stale` was applied, `lifecycle/rotten` is applied >- After 30d of inactivity since `lifecycle/rotten` was applied, the issue is closed > >You can: >- Reopen this issue with `/reopen` >- Mark this issue as fresh with `/remove-lifecycle rotten` >- Offer to help out with [Issue Triage][1] > >Please send feedback to sig-contributor-experience at [kubernetes/community](https://github.com/kubernetes/community). > >/close not-planned > >[1]: https://www.kubernetes.dev/docs/guide/issue-triage/ Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.