search

siderolabs / talos

Talos Linux is a modern Linux distribution built for Kubernetes.
https://www.talos.dev
Mozilla Public License 2.0
6.61k stars 530 forks source link

Unable to create a local talos cluster in version 1.8 #9431

Open tba77 opened 6 days ago

tba77 commented 6 days ago

Bug Report

talosctl create cluster fails with error message context deadline exceeded

Description

When I try to create a local cluster with talosctl create cluster I get context deadline exceeded error, first I thought it was related to the number of worker I try to spin up, I first got that error when I tried talosctl create cluster --workers 3 but it doesn't work even if there is no extra workers, in version 1.7.5 it works for one and two workers when I choose 3 I got the same error. I tried on both amd64 and arm64 (appleSilicon M1) architectures

Logs

validating CIDR and reserving IPs
generating PKI and tokens
creating network talos-default
creating controlplane nodes
creating worker nodes
renamed talosconfig context "talos-default" -> "talos-default-8"
waiting for API
bootstrapping cluster
waiting for etcd to be healthy: OK
waiting for etcd members to be consistent across nodes: OK
waiting for etcd members to be control plane nodes: OK
waiting for apid to be ready: OK
waiting for all nodes memory sizes: OK
waiting for all nodes disk sizes: OK
waiting for no diagnostics: OK
◰ waiting for kubelet to be healthy: 1 error occurred:
    * 10.5.0.2: service "kubelet" not in expected state "Running": current state [Waiting] Error running Containerd(kubelet), going to restart forever: failed to create task: "kubelet": failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: failed to fulfil mount request: open /sys/kernel/security: no such file or directory: unknown
context deadline exceeded

Environment

Client: Tag: v1.8.0 SHA: 5cc935f7 Built: Go version: go1.22.7 OS/Arch: linux/amd64 Server: NODE: 10.5.0.2 Tag: v1.8.0 SHA: 5cc935f7 Built: Go version: go1.22.7 OS/Arch: linux/amd64 Enabled: RBAC

On WSL2: Client Version: v1.30.2 Kustomize Version: v5.0.4-0.20230601165947-6ce0bf390ce3 The connection to the server 127.0.0.1:40215 was refused - did you specify the right host or port

PRETTY_NAME="Debian GNU/Linux 12 (bookworm)" NAME="Debian GNU/Linux" VERSION_ID="12" VERSION="12 (bookworm)" VERSION_CODENAME=bookworm ID=debian HOME_URL="https://www.debian.org/" SUPPORT_URL="https://www.debian.org/support" BUG_REPORT_URL="https://bugs.debian.org/"

smira commented 6 days ago

I guess the error will be different across OS X/Linux?

Either way, the one you posted is probably something missing in the host Linux kernel Docker Desktop is using.

It might be better to create a specific reproducible report per platform with full docker logs available.

dcrespo1 commented 16 hours ago

I am having the same issue as the OP. i am running docker desktop v4.34.2 using WSL2 with Ubuntu v21.04.1

talosctl version Client: Tag: v1.8.0 SHA: 5cc935f7 Built: Go version: go1.22.7 OS/Arch: linux/amd64

kubectl version Client Version: v1.31.1 Kustomize Version: v5.4.2

Here are my docker logs from the talos-default-controlplane-1 container:

docker logs talos-default-controlplane-1 2024/10/09 12:53:24 limited GOMAXPROCS to 4 [talos] 2024/10/09 12:53:24 initialize sequence: 4 phase(s) [talos] 2024/10/09 12:53:24 phase systemRequirements (1/4): 2 tasks(s) [talos] 2024/10/09 12:53:24 task initVolumeLifecycle (2/2): starting [talos] 2024/10/09 12:53:24 task setupSystemDirectory (1/2): starting [talos] 2024/10/09 12:53:24 task initVolumeLifecycle (2/2): done, 118.455µs [talos] 2024/10/09 12:53:24 task setupSystemDirectory (1/2): done, 116.838µs [talos] 2024/10/09 12:53:24 phase systemRequirements (1/4): done, 209.751µs [talos] 2024/10/09 12:53:24 phase etc (2/4): 3 tasks(s) [talos] 2024/10/09 12:53:24 task setUserEnvVars (3/3): starting [talos] 2024/10/09 12:53:24 task setUserEnvVars (3/3): done, 13.599µs [talos] 2024/10/09 12:53:24 task CreateSystemCgroups (1/3): starting [talos] 2024/10/09 12:53:24 task createOSReleaseFile (2/3): starting [talos] task CreateSystemCgroups (1/3): 2024/10/09 12:53:24 using cgroups root: / [talos] 2024/10/09 12:53:24 task createOSReleaseFile (2/3): done, 215.203µs [talos] 2024/10/09 12:53:24 pre-created iptables-nft table 'mangle'/'KUBE-IPTABLES-HINT' {"component": "controller-runtime", "controller": "network.NfTablesChainController"} [talos] 2024/10/09 12:53:24 nftables chains updated {"component": "controller-runtime", "controller": "network.NfTablesChainController", "chains": []} [talos] 2024/10/09 12:53:24 node identity established {"component": "controller-runtime", "controller": "cluster.NodeIdentityController", "node_id": "RRM0rk9svcWkaJSwoR7Dl1SPRuCqjVKn9LKqDW4BUNM"} [talos] 2024/10/09 12:53:24 setting resolvers {"component": "controller-runtime", "controller": "network.ResolverSpecController", "resolvers": ["1.1.1.1", "8.8.8.8"]} [talos] 2024/10/09 12:53:24 setting time servers {"component": "controller-runtime", "controller": "network.TimeServerSpecController", "addresses": ["time.cloudflare.com"]} [talos] 2024/10/09 12:53:24 setting resolvers {"component": "controller-runtime", "controller": "network.ResolverSpecController", "resolvers": ["1.1.1.1", "8.8.8.8"]} [talos] 2024/10/09 12:53:24 setting resolvers {"component": "controller-runtime", "controller": "network.ResolverSpecController", "resolvers": ["127.0.0.11"]} [talos] 2024/10/09 12:53:24 setting time servers {"component": "controller-runtime", "controller": "network.TimeServerSpecController", "addresses": ["time.cloudflare.com"]} [talos] 2024/10/09 12:53:24 ethtool watcher failed to start {"component": "controller-runtime", "controller": "network.LinkStatusController", "error": "error getting family information for ethtool: netlink receive: no such file or directory"} [talos] 2024/10/09 12:53:24 task CreateSystemCgroups (1/3): done, 19.509589ms [talos] 2024/10/09 12:53:24 phase etc (2/4): done, 19.59368ms [talos] 2024/10/09 12:53:24 phase machined (3/4): 2 tasks(s) [talos] 2024/10/09 12:53:24 task startContainerd (2/2): starting [talos] 2024/10/09 12:53:24 task startMachined (1/2): starting [talos] 2024/10/09 12:53:24 servicecontainerd: Starting service [talos] 2024/10/09 12:53:24 servicecontainerd: Running pre state [talos] 2024/10/09 12:53:24 servicecontainerd: Creating service runner [talos] 2024/10/09 12:53:24 TPM device is not available, skipping PCR extension [talos] 2024/10/09 12:53:24 servicemachined: Starting service [talos] 2024/10/09 12:53:24 servicemachined: Running pre state [talos] 2024/10/09 12:53:24 servicemachined: Creating service runner [talos] 2024/10/09 12:53:24 servicemachined: Service started as goroutine [talos] 2024/10/09 12:53:24 servicecontainerd: Process Process(["/bin/containerd" "--address" "/system/run/containerd/containerd.sock" "--state" "/system/run/containerd" "--root" "/system/var/lib/containerd"]) started with PID 21 [talos] 2024/10/09 12:53:24 error dialing ethtool socket {"component": "controller-runtime", "controller": "network.LinkStatusController", "error": "netlink receive: no such file or directory"} [talos] 2024/10/09 12:53:25 servicemachined: Health check successful [talos] 2024/10/09 12:53:25 task startMachined (1/2): done, 1.000610861s [talos] 2024/10/09 12:53:25 servicecontainerd: Health check successful [talos] 2024/10/09 12:53:25 task startContainerd (2/2): done, 1.002202536s [talos] 2024/10/09 12:53:25 phase machined (3/4): done, 1.00222882s [talos] 2024/10/09 12:53:25 phase config (4/4): 1 tasks(s) [talos] 2024/10/09 12:53:25 task loadConfig (1/1): starting [talos] 2024/10/09 12:53:25 downloading config {"component": "controller-runtime", "controller": "config.AcquireController", "platform": "container"} [talos] 2024/10/09 12:53:25 fetching machine config from: USERDATA environment variable [talos] 2024/10/09 12:53:25 machine config loaded successfully {"component": "controller-runtime", "controller": "config.AcquireController", "sources": ["container"]} [talos] 2024/10/09 12:53:25 task loadConfig (1/1): done, 1.459387ms [talos] 2024/10/09 12:53:25 phase config (4/4): done, 1.47656ms [talos] 2024/10/09 12:53:25 initialize sequence: done: 1.023580621s [talos] 2024/10/09 12:53:25 install sequence: 0 phase(s) [talos] 2024/10/09 12:53:25 install sequence: done: 2.388µs [talos] 2024/10/09 12:53:25 serviceapid: Starting service [talos] 2024/10/09 12:53:25 serviceapid: Waiting for service "containerd" to be "up", api certificates [talos] 2024/10/09 12:53:25 boot sequence: 10 phase(s) [talos] 2024/10/09 12:53:25 phase saveConfig (1/10): 1 tasks(s) [talos] 2024/10/09 12:53:25 task saveConfig (1/1): starting [talos] 2024/10/09 12:53:25 task saveConfig (1/1): done, 133.134µs [talos] 2024/10/09 12:53:25 phase saveConfig (1/10): done, 178.498µs [talos] 2024/10/09 12:53:25 phase memorySizeCheck (2/10): 1 tasks(s) [talos] 2024/10/09 12:53:25 task memorySizeCheck (1/1): starting [talos] task memorySizeCheck (1/1): 2024/10/09 12:53:25 skipping memory size check in the container [talos] 2024/10/09 12:53:25 task memorySizeCheck (1/1): done, 12.964µs [talos] 2024/10/09 12:53:25 phase memorySizeCheck (2/10): done, 25.851µs [talos] 2024/10/09 12:53:25 phase diskSizeCheck (3/10): 1 tasks(s) [talos] 2024/10/09 12:53:25 task diskSizeCheck (1/1): starting [talos] task diskSizeCheck (1/1): 2024/10/09 12:53:25 skipping disk size check in the container [talos] 2024/10/09 12:53:25 task diskSizeCheck (1/1): done, 8.745µs [talos] 2024/10/09 12:53:25 phase diskSizeCheck (3/10): done, 19.985µs [talos] 2024/10/09 12:53:25 phase env (4/10): 2 tasks(s) [talos] 2024/10/09 12:53:25 task waitForCARoots (2/2): starting [talos] 2024/10/09 12:53:25 created dns upstream {"component": "controller-runtime", "controller": "network.DNSUpstreamController", "addr": "127.0.0.11", "idx": 0} [talos] 2024/10/09 12:53:25 assigned address {"component": "controller-runtime", "controller": "network.AddressSpecController", "address": "169.254.116.108/32", "link": "lo"} [talos] 2024/10/09 12:53:25 updated dns server nameservers {"component": "dns-resolve-cache", "addrs": ["127.0.0.11:53"]} [talos] 2024/10/09 12:53:25 task setUserEnvVars (1/2): starting [talos] 2024/10/09 12:53:25 task setUserEnvVars (1/2): done, 932.299µs [talos] 2024/10/09 12:53:25 kubeprism KubePrism is enabled {"component": "controller-runtime", "controller": "k8s.KubePrismController", "endpoint": "127.0.0.1:7445"} [talos] 2024/10/09 12:53:25 task waitForCARoots (2/2): done, 253.727µs [talos] 2024/10/09 12:53:25 phase env (4/10): done, 1.533129ms [talos] 2024/10/09 12:53:25 phase dbus (5/10): 1 tasks(s) [talos] 2024/10/09 12:53:25 task startDBus (1/1): starting [talos] 2024/10/09 12:53:25 task startDBus (1/1): done, 1.044402ms [talos] 2024/10/09 12:53:25 phase dbus (5/10): done, 1.182197ms [talos] 2024/10/09 12:53:25 phase sharedFilesystems (6/10): 1 tasks(s) [talos] 2024/10/09 12:53:25 task setupSharedFilesystems (1/1): starting [talos] 2024/10/09 12:53:25 task setupSharedFilesystems (1/1): done, 26.004µs [talos] 2024/10/09 12:53:25 phase sharedFilesystems (6/10): done, 39.72µs [talos] 2024/10/09 12:53:25 phase var (7/10): 1 tasks(s) [talos] 2024/10/09 12:53:25 task setupVarDirectory (1/1): starting [talos] 2024/10/09 12:53:25 task setupVarDirectory (1/1): done, 1.999003ms [talos] 2024/10/09 12:53:25 phase var (7/10): done, 2.04244ms [talos] 2024/10/09 12:53:25 phase userSetup (8/10): 1 tasks(s) [talos] 2024/10/09 12:53:25 task writeUserFiles (1/1): starting [talos] 2024/10/09 12:53:25 task writeUserFiles (1/1): done, 6.328µs [talos] 2024/10/09 12:53:25 phase userSetup (8/10): done, 19.734µs [talos] 2024/10/09 12:53:25 phase extendPCRStartAll (9/10): 1 tasks(s) [talos] 2024/10/09 12:53:25 task extendPCRStartAll (1/1): starting [talos] 2024/10/09 12:53:25 TPM device is not available, skipping PCR extension [talos] 2024/10/09 12:53:25 task extendPCRStartAll (1/1): done, 57.933µs [talos] 2024/10/09 12:53:25 phase extendPCRStartAll (9/10): done, 74.749µs [talos] 2024/10/09 12:53:25 phase startEverything (10/10): 1 tasks(s) [talos] 2024/10/09 12:53:25 task startAllServices (1/1): starting [talos] 2024/10/09 12:53:25 servicecri: Starting service [talos] 2024/10/09 12:53:25 servicecri: Waiting for network [talos] 2024/10/09 12:53:25 servicecri: Running pre state [talos] 2024/10/09 12:53:25 servicecri: Creating service runner [talos] 2024/10/09 12:53:25 servicetrustd: Starting service [talos] 2024/10/09 12:53:25 servicetrustd: Waiting for service "containerd" to be "up", time sync, network [talos] 2024/10/09 12:53:25 servicecri: Process Process(["/bin/containerd" "--address" "/run/containerd/containerd.sock" "--config" "/etc/cri/containerd.toml"]) started with PID 49 [talos] 2024/10/09 12:53:25 serviceetcd: Starting service [talos] 2024/10/09 12:53:25 serviceetcd: Waiting for service "cri" to be "up", time sync, network, etcd spec [talos] task startAllServices (1/1): 2024/10/09 12:53:25 waiting for 7 services [talos] task startAllServices (1/1): 2024/10/09 12:53:25 service "apid" to be "up", service "containerd" to be "up", service "cri" to be "up", service "etcd" to be "up", service "kubelet" to be "up", service "machined" to be "up", service "trustd" to be "up" [talos] 2024/10/09 12:53:25 servicetrustd: Running pre state [talos] 2024/10/09 12:53:25 servicetrustd: Creating service runner [talos] 2024/10/09 12:53:25 servicekubelet: Starting service [talos] 2024/10/09 12:53:25 servicekubelet: Waiting for service "cri" to be "up", time sync, network [talos] 2024/10/09 12:53:25 serviceapid: Running pre state [talos] 2024/10/09 12:53:25 serviceapid: Creating service runner [talos] 2024/10/09 12:53:25 servicetrustd: Started task trustd (PID 116) for container trustd [talos] 2024/10/09 12:53:25 serviceapid: Started task apid (PID 117) for container apid [talos] 2024/10/09 12:53:26 bootstrap request received [talos] 2024/10/09 12:53:26 serviceetcd: Waiting for service "cri" to be "up" [talos] 2024/10/09 12:53:26 servicecri: Health check successful [talos] 2024/10/09 12:53:26 serviceetcd: Running pre state [talos] 2024/10/09 12:53:26 servicekubelet: Running pre state [talos] 2024/10/09 12:53:26 serviceetcd: Failed to run pre stage: failed to pull image "gcr.io/etcd-development/etcd:v3.5.16": 1 error(s) occurred: failed to pull image "gcr.io/etcd-development/etcd:v3.5.16": context canceled [talos] 2024/10/09 12:53:26 serviceetcd: Bootstrap requested [talos] 2024/10/09 12:53:26 serviceetcd: Starting service [talos] 2024/10/09 12:53:26 serviceetcd: Waiting for service "cri" to be "up", time sync, network, etcd spec [talos] 2024/10/09 12:53:26 serviceetcd: Running pre state [talos] 2024/10/09 12:53:26 servicetrustd: Health check successful [talos] 2024/10/09 12:53:26 serviceapid: Health check successful [talos] 2024/10/09 12:53:31 serviceetcd: Creating service runner [talos] 2024/10/09 12:53:31 serviceetcd: Started task etcd (PID 228) for container etcd [talos] 2024/10/09 12:53:34 servicekubelet: Creating service runner [talos] 2024/10/09 12:53:35 servicekubelet: Error running Containerd(kubelet), going to restart forever: failed to create task: "kubelet": failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: failed to fulfil mount request: open /sys/kernel/security: no such file or directory: unknown [talos] 2024/10/09 12:53:36 serviceetcd: Health check successful [talos] 2024/10/09 12:53:36 rendered new static pod {"component": "controller-runtime", "controller": "k8s.StaticPodServerController", "id": "kube-apiserver"} [talos] 2024/10/09 12:53:36 rendered new static pod {"component": "controller-runtime", "controller": "k8s.StaticPodServerController", "id": "kube-controller-manager"} [talos] 2024/10/09 12:53:36 rendered new static pod {"component": "controller-runtime", "controller": "k8s.StaticPodServerController", "id": "kube-scheduler"} [talos] 2024/10/09 12:53:40 servicekubelet: Error running Containerd(kubelet), going to restart forever: failed to create task: "kubelet": failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: failed to fulfil mount request: open /sys/kernel/security: no such file or directory: unknown [talos] task startAllServices (1/1): 2024/10/09 12:53:41 service "kubelet" to be "up" [talos] 2024/10/09 12:53:45 kubernetes endpoint watch error {"component": "controller-runtime", "controller": "k8s.EndpointController", "error": "failed to list v1.Endpoints: Get \"https://10.5.0.2:6443/api/v1/namespaces/default/endpoints?fieldSelector=metadata.name%3Dkubernetes&limit=500&resourceVersion=0\": dial tcp 10.5.0.2:6443: connect: connection refused"} [talos] 2024/10/09 12:53:45 servicekubelet: Error running Containerd(kubelet), going to restart forever: failed to create task: "kubelet": failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: failed to fulfil mount request: open /sys/kernel/security: no such file or directory: unknown [talos] 2024/10/09 12:53:50 servicekubelet: Error running Containerd(kubelet), going to restart forever: failed to create task: "kubelet": failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: failed to fulfil mount request: open /sys/kernel/security: no such file or directory: unknown [talos] 2024/10/09 12:53:55 servicekubelet: Error running Containerd(kubelet), going to restart forever: failed to create task: "kubelet": failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: failed to fulfil mount request: open /sys/kernel/security: no such file or directory: unknown [talos] task startAllServices (1/1): 2024/10/09 12:53:56 service "kubelet" to be "up" [talos] 2024/10/09 12:54:02 servicekubelet: Error running Containerd(kubelet), going to restart forever: failed to create task: "kubelet": failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: failed to fulfil mount request: open /sys/kernel/security: no such file or directory: unknown [talos] 2024/10/09 12:54:07 servicekubelet: Error running Containerd(kubelet), going to restart forever: failed to create task: "kubelet": failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: failed to fulfil mount request: open /sys/kernel/security: no such file or directory: unknown [talos] 2024/10/09 12:54:11 kubernetes endpoint watch error {"component": "controller-runtime", "controller": "k8s.EndpointController", "error": "failed to list v1.Endpoints: Get \"https://10.5.0.2:6443/api/v1/namespaces/default/endpoints?fieldSelector=metadata.name%3Dkubernetes&limit=500&resourceVersion=0\": dial tcp 10.5.0.2:6443: connect: connection refused"}

here are the logs from talos-default-worker-1:

docker logs talos-default-worker-1 2024/10/09 12:53:24 limited GOMAXPROCS to 4 [talos] 2024/10/09 12:53:24 initialize sequence: 4 phase(s) [talos] 2024/10/09 12:53:24 phase systemRequirements (1/4): 2 tasks(s) [talos] 2024/10/09 12:53:24 task initVolumeLifecycle (2/2): starting [talos] 2024/10/09 12:53:24 task initVolumeLifecycle (2/2): done, 84.592µs [talos] 2024/10/09 12:53:24 task setupSystemDirectory (1/2): starting [talos] 2024/10/09 12:53:24 task setupSystemDirectory (1/2): done, 157.606µs [talos] 2024/10/09 12:53:24 phase systemRequirements (1/4): done, 265.324µs [talos] 2024/10/09 12:53:24 phase etc (2/4): 3 tasks(s) [talos] 2024/10/09 12:53:24 task setUserEnvVars (3/3): starting [talos] 2024/10/09 12:53:24 task setUserEnvVars (3/3): done, 18.155µs [talos] 2024/10/09 12:53:24 task CreateSystemCgroups (1/3): starting [talos] 2024/10/09 12:53:24 task createOSReleaseFile (2/3): starting [talos] task CreateSystemCgroups (1/3): 2024/10/09 12:53:24 using cgroups root: / [talos] 2024/10/09 12:53:24 task createOSReleaseFile (2/3): done, 268.656µs [talos] 2024/10/09 12:53:24 node identity established {"component": "controller-runtime", "controller": "cluster.NodeIdentityController", "node_id": "Iwb3p6PEFrmSKY4jl9YLNoMZejSLpxdKWGM6bULkDMa"} [talos] 2024/10/09 12:53:24 setting resolvers {"component": "controller-runtime", "controller": "network.ResolverSpecController", "resolvers": ["127.0.0.11"]} [talos] 2024/10/09 12:53:24 setting time servers {"component": "controller-runtime", "controller": "network.TimeServerSpecController", "addresses": ["time.cloudflare.com"]} [talos] 2024/10/09 12:53:25 setting resolvers {"component": "controller-runtime", "controller": "network.ResolverSpecController", "resolvers": ["127.0.0.11"]} [talos] 2024/10/09 12:53:25 pre-created iptables-nft table 'mangle'/'KUBE-IPTABLES-HINT' {"component": "controller-runtime", "controller": "network.NfTablesChainController"} [talos] 2024/10/09 12:53:25 nftables chains updated {"component": "controller-runtime", "controller": "network.NfTablesChainController", "chains": []} [talos] 2024/10/09 12:53:25 setting time servers {"component": "controller-runtime", "controller": "network.TimeServerSpecController", "addresses": ["time.cloudflare.com"]} [talos] 2024/10/09 12:53:25 ethtool watcher failed to start {"component": "controller-runtime", "controller": "network.LinkStatusController", "error": "error getting family information for ethtool: netlink receive: no such file or directory"} [talos] 2024/10/09 12:53:25 error dialing ethtool socket {"component": "controller-runtime", "controller": "network.LinkStatusController", "error": "netlink receive: no such file or directory"} [talos] 2024/10/09 12:53:25 task CreateSystemCgroups (1/3): done, 21.640956ms [talos] 2024/10/09 12:53:25 phase etc (2/4): done, 21.758349ms [talos] 2024/10/09 12:53:25 phase machined (3/4): 2 tasks(s) [talos] 2024/10/09 12:53:25 task startContainerd (2/2): starting [talos] 2024/10/09 12:53:25 servicecontainerd: Starting service [talos] 2024/10/09 12:53:25 servicecontainerd: Running pre state [talos] 2024/10/09 12:53:25 task startMachined (1/2): starting [talos] 2024/10/09 12:53:25 TPM device is not available, skipping PCR extension [talos] 2024/10/09 12:53:25 servicemachined: Starting service [talos] 2024/10/09 12:53:25 servicemachined: Running pre state [talos] 2024/10/09 12:53:25 servicecontainerd: Creating service runner [talos] 2024/10/09 12:53:25 servicemachined: Creating service runner [talos] 2024/10/09 12:53:25 servicemachined: Service started as goroutine [talos] 2024/10/09 12:53:25 servicecontainerd: Process Process(["/bin/containerd" "--address" "/system/run/containerd/containerd.sock" "--state" "/system/run/containerd" "--root" "/system/var/lib/containerd"]) started with PID 20 [talos] 2024/10/09 12:53:26 servicemachined: Health check successful [talos] 2024/10/09 12:53:26 task startMachined (1/2): done, 1.000717039s [talos] 2024/10/09 12:53:26 servicecontainerd: Health check successful [talos] 2024/10/09 12:53:26 task startContainerd (2/2): done, 1.003949668s [talos] 2024/10/09 12:53:26 phase machined (3/4): done, 1.003975296s [talos] 2024/10/09 12:53:26 phase config (4/4): 1 tasks(s) [talos] 2024/10/09 12:53:26 task loadConfig (1/1): starting [talos] 2024/10/09 12:53:26 downloading config {"component": "controller-runtime", "controller": "config.AcquireController", "platform": "container"} [talos] 2024/10/09 12:53:26 fetching machine config from: USERDATA environment variable [talos] 2024/10/09 12:53:26 machine config loaded successfully {"component": "controller-runtime", "controller": "config.AcquireController", "sources": ["container"]} [talos] 2024/10/09 12:53:26 task loadConfig (1/1): done, 1.158513ms [talos] 2024/10/09 12:53:26 phase config (4/4): done, 1.18053ms [talos] 2024/10/09 12:53:26 initialize sequence: done: 1.027236353s [talos] 2024/10/09 12:53:26 install sequence: 0 phase(s) [talos] 2024/10/09 12:53:26 install sequence: done: 2.418µs [talos] 2024/10/09 12:53:26 serviceapid: Starting service [talos] 2024/10/09 12:53:26 serviceapid: Waiting for service "containerd" to be "up", api certificates [talos] 2024/10/09 12:53:26 boot sequence: 10 phase(s) [talos] 2024/10/09 12:53:26 phase saveConfig (1/10): 1 tasks(s) [talos] 2024/10/09 12:53:26 task saveConfig (1/1): starting [talos] 2024/10/09 12:53:26 task saveConfig (1/1): done, 99.915µs [talos] 2024/10/09 12:53:26 phase saveConfig (1/10): done, 143.555µs [talos] 2024/10/09 12:53:26 phase memorySizeCheck (2/10): 1 tasks(s) [talos] 2024/10/09 12:53:26 task memorySizeCheck (1/1): starting [talos] task memorySizeCheck (1/1): 2024/10/09 12:53:26 skipping memory size check in the container [talos] 2024/10/09 12:53:26 task memorySizeCheck (1/1): done, 19.166µs [talos] 2024/10/09 12:53:26 phase memorySizeCheck (2/10): done, 34.711µs [talos] 2024/10/09 12:53:26 phase diskSizeCheck (3/10): 1 tasks(s) [talos] 2024/10/09 12:53:26 task diskSizeCheck (1/1): starting [talos] task diskSizeCheck (1/1): 2024/10/09 12:53:26 skipping disk size check in the container [talos] 2024/10/09 12:53:26 task diskSizeCheck (1/1): done, 5.634µs [talos] 2024/10/09 12:53:26 phase diskSizeCheck (3/10): done, 13.705µs [talos] 2024/10/09 12:53:26 phase env (4/10): 2 tasks(s) [talos] 2024/10/09 12:53:26 task waitForCARoots (2/2): starting [talos] 2024/10/09 12:53:26 task setUserEnvVars (1/2): starting [talos] 2024/10/09 12:53:26 task setUserEnvVars (1/2): done, 37.274µs [talos] 2024/10/09 12:53:26 task waitForCARoots (2/2): done, 109.768µs [talos] 2024/10/09 12:53:26 phase env (4/10): done, 118.138µs [talos] 2024/10/09 12:53:26 phase dbus (5/10): 1 tasks(s) [talos] 2024/10/09 12:53:26 task startDBus (1/1): starting [talos] 2024/10/09 12:53:26 assigned address {"component": "controller-runtime", "controller": "network.AddressSpecController", "address": "169.254.116.108/32", "link": "lo"} [talos] 2024/10/09 12:53:26 kubeprism KubePrism is enabled {"component": "controller-runtime", "controller": "k8s.KubePrismController", "endpoint": "127.0.0.1:7445"} [talos] 2024/10/09 12:53:26 created dns upstream {"component": "controller-runtime", "controller": "network.DNSUpstreamController", "addr": "127.0.0.11", "idx": 0} [talos] 2024/10/09 12:53:26 updated dns server nameservers {"component": "dns-resolve-cache", "addrs": ["127.0.0.11:53"]} [talos] 2024/10/09 12:53:26 task startDBus (1/1): done, 4.577487ms [talos] 2024/10/09 12:53:26 phase dbus (5/10): done, 4.617516ms [talos] 2024/10/09 12:53:26 phase sharedFilesystems (6/10): 1 tasks(s) [talos] 2024/10/09 12:53:26 task setupSharedFilesystems (1/1): starting [talos] 2024/10/09 12:53:26 task setupSharedFilesystems (1/1): done, 39.855µs [talos] 2024/10/09 12:53:26 phase sharedFilesystems (6/10): done, 58.481µs [talos] 2024/10/09 12:53:26 phase var (7/10): 1 tasks(s) [talos] 2024/10/09 12:53:26 task setupVarDirectory (1/1): starting [talos] 2024/10/09 12:53:26 servicekubelet: Starting service [talos] 2024/10/09 12:53:26 servicekubelet: Waiting for service "cri" to be "up", time sync, network [talos] 2024/10/09 12:53:26 task setupVarDirectory (1/1): done, 1.538584ms [talos] 2024/10/09 12:53:26 phase var (7/10): done, 1.591124ms [talos] 2024/10/09 12:53:26 phase userSetup (8/10): 1 tasks(s) [talos] 2024/10/09 12:53:26 task writeUserFiles (1/1): starting [talos] 2024/10/09 12:53:26 task writeUserFiles (1/1): done, 6.424µs [talos] 2024/10/09 12:53:26 phase userSetup (8/10): done, 19.233µs [talos] 2024/10/09 12:53:26 phase extendPCRStartAll (9/10): 1 tasks(s) [talos] 2024/10/09 12:53:26 task extendPCRStartAll (1/1): starting [talos] 2024/10/09 12:53:26 TPM device is not available, skipping PCR extension [talos] 2024/10/09 12:53:26 task extendPCRStartAll (1/1): done, 70.376µs [talos] 2024/10/09 12:53:26 phase extendPCRStartAll (9/10): done, 123.233µs [talos] 2024/10/09 12:53:26 phase startEverything (10/10): 1 tasks(s) [talos] 2024/10/09 12:53:26 task startAllServices (1/1): starting [talos] 2024/10/09 12:53:26 servicecri: Starting service [talos] 2024/10/09 12:53:26 servicecri: Waiting for network [talos] 2024/10/09 12:53:26 servicecri: Running pre state [talos] task startAllServices (1/1): 2024/10/09 12:53:26 waiting for 5 services [talos] task startAllServices (1/1): 2024/10/09 12:53:26 service "apid" to be "up", service "containerd" to be "up", service "cri" to be "up", service "kubelet" to be "up", service "machined" to be "up" [talos] 2024/10/09 12:53:26 servicecri: Creating service runner [talos] 2024/10/09 12:53:26 servicecri: Process Process(["/bin/containerd" "--address" "/run/containerd/containerd.sock" "--config" "/etc/cri/containerd.toml"]) started with PID 48 [talos] 2024/10/09 12:53:26 serviceapid: Running pre state [talos] 2024/10/09 12:53:26 serviceapid: Creating service runner [talos] 2024/10/09 12:53:26 serviceapid: Started task apid (PID 86) for container apid [talos] 2024/10/09 12:53:27 servicekubelet: Waiting for service "cri" to be "up" [talos] 2024/10/09 12:53:27 servicecri: Health check successful [talos] 2024/10/09 12:53:27 servicekubelet: Running pre state [talos] 2024/10/09 12:53:27 serviceapid: Health check successful [talos] 2024/10/09 12:53:34 servicekubelet: Creating service runner [talos] 2024/10/09 12:53:35 servicekubelet: Error running Containerd(kubelet), going to restart forever: failed to create task: "kubelet": failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: failed to fulfil mount request: open /sys/kernel/security: no such file or directory: unknown