search

aws / eks-anywhere

Run Amazon EKS on your own infrastructure 🚀
https://anywhere.eks.amazonaws.com
Apache License 2.0
1.96k stars 284 forks source link

Bottlerocket OVA is missing kubeadm #662

Closed david-wirelab closed 2 years ago

david-wirelab commented 2 years ago

What happened: Tried to install a cluster with eksctl to no avail.

What you expected to happen: EKS cluster deploys just fine.

How to reproduce it (as minimally and precisely as possible): Create a template from this OVA and spin up a VM from it: https://anywhere-assets.eks.amazonaws.com/releases/bundles/4/artifacts/ova/1-21/bottlerocket-v1.21.2-eks-d-1-21-6-eks-a-4-amd64.ova

Anything else we need to know?:

Error log from eksctl

2021-11-18T09:56:45.646Z    V6  Executing command   {"cmd": "/usr/bin/docker run --name eksa_kubectl_1637229405646171759 -i --network host -v /home/foo/EKS_Cluster:/home/foo/EKS_Cluster -w /home/foo/EKS_Cluster -v /var/run/docker.sock:/var/run/docker.sock --entrypoint kubectl public.ecr.aws/eks-anywhere/cli-tools:v0.1.0-eks-a-4 wait --timeout 60m --for=condition=ControlPlaneReady clusters.cluster.x-k8s.io/prod --kubeconfig prod/generated/prod.kind.kubeconfig -n eksa-system"}
error: timed out waiting for the condition on clusters/prod

Error from Bottlerocket VM

Screenshot 2021-11-18 at 12 23 51

Environment:

vignesh-goutham commented 2 years ago

Hi @david-wirelab thanks for trying out EKS-A with Bottlerocket. It looks like there were some errors with the bootstrap container. Could you provide journal logs from the Bottlerocket node? You can ssh into the node with ec2-user and run journalctl _COMM=host-ctr The first run of bootstrap container will contain the proper error mesage.

david-wirelab commented 2 years ago

Hi @vignesh-goutham thanks for your reply. Please see the journal logs below.

[ec2-user@172 ~]$ sudo sheltie
bash-5.0# journalctl _COMM=host-ctr
-- Journal begins at Fri 2021-11-19 09:08:54 UTC, ends at Fri 2021-11-19 09:14:10 UTC. --
Nov 19 09:09:05 172.20.0.110 host-ctr[2859]: time="2021-11-19T09:09:05Z" level=warning msg="ecr-public: failed to get authorization token, falling back to default resolver (unauthenticated pull)"
Nov 19 09:09:05 172.20.0.110 host-ctr[2837]: time="2021-11-19T09:09:05Z" level=warning msg="ecr-public: failed to get authorization token, falling back to default resolver (unauthenticated pull)"
Nov 19 09:09:05 172.20.0.110 host-ctr[2838]: time="2021-11-19T09:09:05Z" level=warning msg="ecr-public: failed to get authorization token, falling back to default resolver (unauthenticated pull)"
Nov 19 09:09:07 172.20.0.110 host-ctr[2859]: time="2021-11-19T09:09:07Z" level=info msg="pulled image successfully" img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:09:07 172.20.0.110 host-ctr[2859]: time="2021-11-19T09:09:07Z" level=info msg="unpacking image..." img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:09:10 172.20.0.110 host-ctr[2837]: time="2021-11-19T09:09:10Z" level=info msg="pulled image successfully" img="public.ecr.aws/bottlerocket/bottlerocket-admin:v0.7.2"
Nov 19 09:09:10 172.20.0.110 host-ctr[2837]: time="2021-11-19T09:09:10Z" level=info msg="unpacking image..." img="public.ecr.aws/bottlerocket/bottlerocket-admin:v0.7.2"
Nov 19 09:09:10 172.20.0.110 host-ctr[2838]: time="2021-11-19T09:09:10Z" level=info msg="pulled image successfully" img="public.ecr.aws/eks-anywhere/bottlerocket-bootstrap:v1-21-6-eks-a-4"
Nov 19 09:09:10 172.20.0.110 host-ctr[2838]: time="2021-11-19T09:09:10Z" level=info msg="unpacking image..." img="public.ecr.aws/eks-anywhere/bottlerocket-bootstrap:v1-21-6-eks-a-4"
Nov 19 09:09:16 172.20.0.110 host-ctr[2838]: time="2021-11-19T09:09:16Z" level=info msg="Container does not exist, proceeding to create it" ctr-id=kubeadm-bootstrap
Nov 19 09:09:17 172.20.0.110 host-ctr[2838]: time="2021-11-19T09:09:17Z" level=info msg="container task does not exist, proceeding to create it" container-id=kubeadm-bootstrap
Nov 19 09:09:17 172.20.0.110 host-ctr[2838]: time="2021-11-19T09:09:17Z" level=info msg="successfully started container task"
Nov 19 09:09:17 172.20.0.110 host-ctr[2838]: Waiting for bottlerocket boot to complete...
Nov 19 09:09:17 172.20.0.110 host-ctr[2838]: Waiting for multi-user.target to come up
Nov 19 09:09:17 172.20.0.110 host-ctr[2838]: Created dbus connection to talk to systemd
Nov 19 09:09:17 172.20.0.110 host-ctr[2838]: Received status change: map[-.mount:0xc0002c9768 -.slice:0xc0002c7cb0 SuSEfirewall2_init.service:0xc0002c2b58 acpid.service:0xc0002c54e8 activate-configured.service:0xc0002c4dc8 activate-multi-user.service:0xc0002c8760 apiserver.service:0xc0002c2e50 audit-rules.service:0xc0002c6d40 basic.target:0xc0002c7298 blockdev@dev-loop0.target:0xc0002c7330 blockdev@dev-loop1.target:0xc0002c0a18 blockdev@dev-nvme0n1p12.target:0xc0002c4908 blockdev@dev-nvme0n1p3.target:0xc0002c50c0 blockdev@dev-nvme0n2p1.target:0xc0002c4610 boot.mount:0xc0002c15f8 chronyd.service:0xc0002c28f8 configured.target:0xc0002c2730 containerd.service:0xc0002c56b0 dbus-broker.service:0xc0002c3998 dbus.socket:0xc0002c6c10 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000.device:0xc0002c3440 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart1.device:0xc0002c6458 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart10.device:0xc0002c20a8 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart11.device:0xc0002c5580 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart12.device:0xc0002c2db8 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart2.device:0xc0002c89c0 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart3.device:0xc0002c1268 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart4.device:0xc0002c9048 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart5.device:0xc0002c5b70 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart6.device:0xc0002c49a0 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart7.device:0xc0002c8468 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart8.device:0xc0002c36a0 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart9.device:0xc0002c7888 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001.device:0xc0002c3dc0 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart1.device:0xc0002c3018 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart10.device:0xc0002c4ad0 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart11.device:0xc0002c4ef8 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart12.device:0xc0002c1be8 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart2.device:0xc0002c5d38 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart3.device:0xc0002c5748 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart4.device:0xc0002c6030 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart5.device:0xc0002c6880 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart6.device:0xc0002c11d0 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart7.device:0xc0002c46a8 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart8.device:0xc0002c8a58 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart9.device:0xc0002c4280 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000002.device:0xc0002c0260 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000002\x2dpart1.device:0xc0002c4318 dev-disk-by\x2dpartlabel-BIOS\x2dBOOT.device:0xc0002c8040 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dBOOT\x2dA.device:0xc0002c7f10 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dBOOT\x2dB.device:0xc0002c8630 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dDATA.device:0xc0002c0c78 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dHASH\x2dA.device:0xc0002c0558 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dHASH\x2dB.device:0xc0002c6f08 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dPRIVATE.device:0xc0002c05f0 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dRESERVED\x2dA.device:0xc0002c80d8 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dRESERVED\x2dB.device:0xc0002c5ad8 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dROOT\x2dA.device:0xc0002c8cb8 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dROOT\x2dB.device:0xc0002c30b0 dev-disk-by\x2dpartlabel-EFI\x2dBACKUP.device:0xc0002c2698 dev-disk-by\x2dpartlabel-EFI\x2dSYSTEM.device:0xc0002c9210 dev-disk-by\x2dpartuuid-33ae178a\x2df579\x2d4cb3\x2db462\x2d8a61ab80a15f.device:0xc0002c2568 dev-disk-by\x2dpartuuid-3cc2e645\x2df1e5\x2d45fe\x2dad17\x2de339d8a4c583.device:0xc0002c8500 dev-disk-by\x2dpartuuid-456d72a9\x2df299\x2d4bac\x2daec0\x2d963b3edf4e1e.device:0xc0002c5320 dev-disk-by\x2dpartuuid-496c628c\x2d5d33\x2d4f19\x2d9e08\x2d850333b40b0c.device:0xc0002c4448 dev-disk-by\x2dpartuuid-8900e6d2\x2d72e9\x2d4916\x2d8f3d\x2de68cc512fa6f.device:0xc0002c8c20 dev-disk-by\x2dpartuuid-93beed59\x2df3bb\x2d4a06\x2d8540\x2d59a48281dac8.device:0xc0002c04c0 dev-disk-by\x2dpartuuid-a107a78e\x2dde3c\x2d4c3f\x2db85f\x2d384eee820b61.device:0xc0002c7038 dev-disk-by\x2dpartuuid-af935829\x2d5ee4\x2d4974\x2d9f6a\x2d2048e060d98e.device:0xc0002c83d0 dev-disk-by\x2dpartuuid-b51ed158\x2d126b\x2d436a\x2db319\x2d6a28fd171e09.device:0xc0002c2d20 dev-disk-by\x2dpartuuid-b8f3dd15\x2d4e23\x2d467f\x2d96ad\x2dd02cd95d279d.device:0xc0002c7e78 dev-disk-by\x2dpartuuid-d7a34286\x2deb76\x2d498c\x2db059\x2d69d78792cb2d.device:0xc0002c3c90 dev-disk-by\x2dpartuuid-dec61052\x2d415b\x2d41cb\x2d9dee\x2dc388acaedc9b.device:0xc0002c5028 dev-disk-by\x2dpartuuid-f6b8b07f\x2dacab\x2d4ef5\x2dad07\x2d3801da86361f.device:0xc0002c3570 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1.device:0xc0002c1008 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart1.device:0xc0002c69b0 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart10.device:0xc0002c1430 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart11.device:0xc0002c4e60 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart12.device:0xc0002c3868 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart2.device:0xc0002c73c8 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart3.device:0xc0002c9178 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart4.device:0xc0002c3a30 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart5.device:0xc0002c6ca8 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart6.device:0xc0002c34d8 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart7.device:0xc0002c7920 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart8.device:0xc0002c2a28 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart9.device:0xc0002c5c08 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d2.device:0xc0002c7b80 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d2\x2dpart1.device:0xc0002c3148 dev-disk-by\x2duuid-26e4b5d3\x2d6a65\x2d4ed6\x2d86d8\x2df3223d9c9e91.device:0xc0002c4c98 dev-disk-by\x2duuid-3fda7e53\x2d959a\x2d4e9c\x2dac60\x2d17c29a7f8d01.device:0xc0002c87f8 dev-disk-by\x2duuid-582db298\x2db784\x2d4967\x2d927e\x2d8075bb78fb06.device:0xc0002c82a0 dev-disk-by\x2duuid-79CA\x2d69E8.device:0xc0002c2bf0 dev-disk-by\x2duuid-ab2695d4\x2dc79b\x2d47f1\x2dba1b\x2dfd0da33ad10e.device:0xc0002c90e0 dev-disk-by\x2duuid-e57e7486\x2ddee8\x2d4ad1\x2d9caf\x2d8e1fcf8f11a6.device:0xc0002c8de8 dev-dm\x2d0.device:0xc0002c5ca0 dev-hugepages.mount:0xc0002c0428 dev-loop0.device:0xc0002c2860 dev-loop1.device:0xc0002c0e40 dev-mqueue.mount:0xc0002c27c8 dev-nvme0n1.device:0xc0002c3e58 dev-nvme0n1p1.device:0xc0002c18f0 dev-nvme0n1p10.device:0xc0002c79b8 dev-nvme0n1p11.device:0xc0002c41e8 dev-nvme0n1p12.device:0xc0002c6160 dev-nvme0n1p2.device:0xc0002c1b50 dev-nvme0n1p3.device:0xc0002c21d8 dev-nvme0n1p4.device:0xc0002c1ab8 dev-nvme0n1p5.device:0xc0002c7590 dev-nvme0n1p6.device:0xc0002c7c18 dev-nvme0n1p7.device:0xc0002c5dd0 dev-nvme0n1p8.device:0xc0002c8d50 dev-nvme0n1p9.device:0xc0002c0098 dev-nvme0n2.device:0xc0002c2270 dev-nvme0n2p1.device:0xc0002c1560 dev-ttyS0.device:0xc0002c70d0 dev-ttyS1.device:0xc0002c0720 dev-ttyS2.device:0xc0002c8928 dev-ttyS3.device:0xc0002c1e48 disable-kexec-load.service:0xc0002c1988 early-boot-config.service:0xc0002c07b8 emergency.service:0xc0002c6a48 emergency.target:0xc0002c4d30 etc-cni.mount:0xc0002c8b88 first-boot-complete.target:0xc0002c9638 getty.target:0xc0002c9470 host-containerd.service:0xc0002c93d8 host-containers@admin.service:0xc0002c1398 host-containers@kubeadm-bootstrap.service:0xc0002c5158 init.scope:0xc0002c1138 initrd-root-fs.target:0xc0002c2010 isdn.service:0xc0002c5618 kmod-static-nodes.service:0xc0002c2140 kubelet.service:0xc0002c86c8 ldconfig.service:0xc0002c8e80 load-crash-kernel.service:0xc0002c1c80 local-fs-pre.target:0xc0002c7628 local-fs.target:0xc0002c3b60 local-var-lib-bottlerocket.mount:0xc0002c47d8 local-var-lib-kernel\x2ddevel-lower.mount:0xc0002c6290 local.mount:0xc0002c64f0 mark-successful-boot.service:0xc0002c08e8 metricdog.service:0xc0002c2438 metricdog.timer:0xc0002c2c88 migrator.service:0xc0002c7168 mnt.mount:0xc0002c57e0 modprobe@configfs.service:0xc0002c51f0 modprobe@fuse.service:0xc0002c4150 multi-user.target:0xc0002c4870 network-online.target:0xc0002c3ac8 network-pre.target:0xc0002c7a50 network.target:0xc0002c8890 openvswitch.service:0xc0002c63c0 opt.mount:0xc0002c1d18 paths.target:0xc0002c6328 preconfigured.target:0xc0002c23a0 prepare-boot.service:0xc0002c4f90 prepare-local.service:0xc0002c9340 rdma.service:0xc0002c6b78 remote-fs-pre.target:0xc0002c60c8 remote-fs.target:0xc0002c8fb0 rescue.service:0xc0002c7fa8 rescue.target:0xc0002c66b8 run-host\x2dcontainerd-io.containerd.runtime.v2.task-default-kubeadm\x2dbootstrap-rootfs.mount:0xc0002c6750 runtime.slice:0xc0002c14c8 selinux-policy-files.service:0xc0002c67e8 send-boot-success.service:0xc0002c6dd8 set-hostname.service:0xc0002c6e70 settings-applier.service:0xc0002c4020 shutdown.target:0xc0002c8f18 slices.target:0xc0002c4740 sockets.target:0xc0002c8598 storewolf.service:0xc0002c24d0 sundog.service:0xc0002c7200 swap.target:0xc0002c1690 sys-devices-pci0000:00-0000:00:15.0-0000:03:00.0-net-eth0.device:0xc0002c02f8 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p1.device:0xc0002c5910 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p10.device:0xc0002c74f8 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p11.device:0xc0002c31e0 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p12.device:0xc0002c1db0 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p2.device:0xc0002c53b8 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p3.device:0xc0002c8af0 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p4.device:0xc0002c3310 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p5.device:0xc0002c7de0 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p6.device:0xc0002c2ac0 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p7.device:0xc0002c44e0 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p8.device:0xc0002c37d0 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p9.device:0xc0002c0ed8 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1.device:0xc0002c33a8 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n2-nvme0n2p1.device:0xc0002c3608 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n2.device:0xc0002c1300 sys-devices-platform-serial8250-tty-ttyS0.device:0xc0002c2ee8 sys-devices-platform-serial8250-tty-ttyS1.device:0xc0002c7758 sys-devices-platform-serial8250-tty-ttyS2.device:0xc0002c4a38 sys-devices-platform-serial8250-tty-ttyS3.device:0xc0002c6588 sys-devices-virtual-block-dm\x2d0.device:0xc0002c2600 sys-devices-virtual-block-loop0.device:0xc0002c6fa0 sys-devices-virtual-block-loop1.device:0xc0002c7ae8 sys-fs-fuse-connections.mount:0xc0002c1f78 sys-kernel-config.mount:0xc0002c8208 sys-kernel-debug.mount:0xc0002c5878 sys-kernel-tracing.mount:0xc0002c6ae0 sys-module-configfs.device:0xc0002c4c00 sys-module-fuse.device:0xc0002c7d48 sys-subsystem-net-devices-eth0.device:0xc0002c2990 sysinit.target:0xc0002c0f70 syslog.service:0xc0002c76c0 syslog.socket:0xc0002c17c0 sysroot.mount:0xc0002c2308 system-host\x2dcontainers.slice:0xc0002c92a8 system-modprobe.slice:0xc0002c5288 system.slice:0xc0002c8170 systemd-fsck-root.service:0xc0002c43b0 systemd-hwdb-update.service:0xc0002c9508 systemd-initctl.service:0xc0002c5a40 systemd-initctl.socket:0xc0002c96d0 systemd-journal-catalog-update.service:0xc0002c0d10 systemd-journal-flush.service:0xc0002c5450 systemd-journald-audit.socket:0xc0002c3bf8 systemd-journald-dev-log.socket:0xc0002c0130 systemd-journald.service:0xc0002c3d28 systemd-journald.socket:0xc0002c59a8 systemd-machine-id-commit.service:0xc0002c77f0 systemd-modules-load.service:0xc0002c4b68 systemd-pstore.service:0xc0002c3ef0 systemd-random-seed.service:0xc0002c6620 systemd-remount-fs.service:0xc0002c5f00 systemd-repart.service:0xc0002c61f8 systemd-sysctl.service:0xc0002c1a20 systemd-sysusers.service:0xc0002c3278 systemd-tmpfiles-clean.service:0xc0002c5f98 systemd-tmpfiles-clean.timer:0xc0002c3f88 systemd-tmpfiles-setup-dev.service:0xc0002c1ee0 systemd-tmpfiles-setup.service:0xc0002c0688 systemd-udev-settle.service:0xc0002c0980 systemd-udev-trigger.service:0xc0002c0be0 systemd-udevd-control.socket:0xc0002c0390 systemd-udevd-kernel.socket:0xc0002c0da8 systemd-udevd.service:0xc0002c6918 systemd-update-done.service:0xc0002c40b8 time-set.target:0xc0002c1858 timers.target:0xc0002c8338 tmp.mount:0xc0002c0000 umount.target:0xc0002c95a0 var-lib-bottlerocket.mount:0xc0002c5e68 var-lib-kernel\x2ddevel-lower.mount:0xc0002c7460 var.mount:0xc0002c10a0 vmtoolsd.service:0xc0002c4578 wicked.service:0xc0002c3738 wickedd-auto4.service:0xc0002c01c8 wickedd-dhcp4.service:0xc0002c2f80 wickedd-dhcp6.service:0xc0002c0ab0 wickedd-nanny.service:0xc0002c1728 wickedd.service:0xc0002c0850 x86_64\x2dbottlerocket\x2dlinux\x2dgnu-sys\x2droot-usr-share-licenses.mount:0xc0002c3900 x86_64\x2dbottlerocket\x2dlinux\x2dgnu-sys\x2droot-usr-src-kernels.mount:0xc0002c0b48]
Nov 19 09:09:18 172.20.0.110 host-ctr[2837]: time="2021-11-19T09:09:18Z" level=info msg="Container does not exist, proceeding to create it" ctr-id=admin
Nov 19 09:09:18 172.20.0.110 host-ctr[2837]: time="2021-11-19T09:09:18Z" level=info msg="container task does not exist, proceeding to create it" container-id=admin
Nov 19 09:09:18 172.20.0.110 host-ctr[2837]: time="2021-11-19T09:09:18Z" level=info msg="successfully started container task"
Nov 19 09:09:18 172.20.0.110 host-ctr[2837]: Server listening on 0.0.0.0 port 22.
Nov 19 09:09:18 172.20.0.110 host-ctr[2837]: Server listening on :: port 22.
Nov 19 09:09:19 172.20.0.110 host-ctr[2838]: Received status change: map[run-host\x2dcontainerd-io.containerd.runtime.v2.task-default-admin-rootfs.mount:0xc0001e60c8]
Nov 19 09:09:20 172.20.0.110 host-ctr[2838]: Received status change: map[activate-multi-user.service:0xc0002547f8 kubelet.service:0xc000254760 multi-user.target:0xc000250870]
Nov 19 09:09:20 172.20.0.110 host-ctr[2838]: multi-user.target service is active and running
Nov 19 09:09:20 172.20.0.110 host-ctr[2838]: Waiting for kubelet.service to come up
Nov 19 09:09:20 172.20.0.110 host-ctr[2838]: Created dbus connection to talk to systemd
Nov 19 09:09:20 172.20.0.110 host-ctr[2838]: Received status change: map[-.mount:0xc00030f800 -.slice:0xc00030dd48 SuSEfirewall2_init.service:0xc000308b58 acpid.service:0xc00030b4e8 activate-configured.service:0xc00030adc8 activate-multi-user.service:0xc00030e7f8 apiserver.service:0xc000308e50 audit-rules.service:0xc00030cdd8 basic.target:0xc00030d330 blockdev@dev-loop0.target:0xc00030d3c8 blockdev@dev-loop1.target:0xc000306a18 blockdev@dev-nvme0n1p12.target:0xc00030a908 blockdev@dev-nvme0n1p3.target:0xc00030b0c0 blockdev@dev-nvme0n2p1.target:0xc00030a610 boot.mount:0xc0003075f8 chronyd.service:0xc0003088f8 configured.target:0xc000308730 containerd.service:0xc00030b6b0 dbus-broker.service:0xc000309998 dbus.socket:0xc00030cca8 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000.device:0xc000309440 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart1.device:0xc00030c4f0 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart10.device:0xc0003080a8 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart11.device:0xc00030b580 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart12.device:0xc000308db8 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart2.device:0xc00030ea58 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart3.device:0xc000307268 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart4.device:0xc00030f0e0 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart5.device:0xc00030bb70 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart6.device:0xc00030a9a0 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart7.device:0xc00030e500 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart8.device:0xc0003096a0 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart9.device:0xc00030d9b8 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001.device:0xc000309dc0 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart1.device:0xc000309018 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart10.device:0xc00030aad0 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart11.device:0xc00030aef8 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart12.device:0xc000307be8 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart2.device:0xc00030bd38 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart3.device:0xc00030b748 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart4.device:0xc00030c030 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart5.device:0xc00030c918 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart6.device:0xc0003071d0 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart7.device:0xc00030a6a8 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart8.device:0xc00030eaf0 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart9.device:0xc00030a280 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000002.device:0xc000306260 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000002\x2dpart1.device:0xc00030a318 dev-disk-by\x2dpartlabel-BIOS\x2dBOOT.device:0xc00030e0d8 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dBOOT\x2dA.device:0xc00030dfa8 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dBOOT\x2dB.device:0xc00030e6c8 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dDATA.device:0xc000306c78 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dHASH\x2dA.device:0xc000306558 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dHASH\x2dB.device:0xc00030cfa0 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dPRIVATE.device:0xc0003065f0 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dRESERVED\x2dA.device:0xc00030e170 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dRESERVED\x2dB.device:0xc00030bad8 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dROOT\x2dA.device:0xc00030ed50 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dROOT\x2dB.device:0xc0003090b0 dev-disk-by\x2dpartlabel-EFI\x2dBACKUP.device:0xc000308698 dev-disk-by\x2dpartlabel-EFI\x2dSYSTEM.device:0xc00030f2a8 dev-disk-by\x2dpartuuid-33ae178a\x2df579\x2d4cb3\x2db462\x2d8a61ab80a15f.device:0xc000308568 dev-disk-by\x2dpartuuid-3cc2e645\x2df1e5\x2d45fe\x2dad17\x2de339d8a4c583.device:0xc00030e598 dev-disk-by\x2dpartuuid-456d72a9\x2df299\x2d4bac\x2daec0\x2d963b3edf4e1e.device:0xc00030b320 dev-disk-by\x2dpartuuid-496c628c\x2d5d33\x2d4f19\x2d9e08\x2d850333b40b0c.device:0xc00030a448 dev-disk-by\x2dpartuuid-8900e6d2\x2d72e9\x2d4916\x2d8f3d\x2de68cc512fa6f.device:0xc00030ecb8 dev-disk-by\x2dpartuuid-93beed59\x2df3bb\x2d4a06\x2d8540\x2d59a48281dac8.device:0xc0003064c0 dev-disk-by\x2dpartuuid-a107a78e\x2dde3c\x2d4c3f\x2db85f\x2d384eee820b61.device:0xc00030d0d0 dev-disk-by\x2dpartuuid-af935829\x2d5ee4\x2d4974\x2d9f6a\x2d2048e060d98e.device:0xc00030e468 dev-disk-by\x2dpartuuid-b51ed158\x2d126b\x2d436a\x2db319\x2d6a28fd171e09.device:0xc000308d20 dev-disk-by\x2dpartuuid-b8f3dd15\x2d4e23\x2d467f\x2d96ad\x2dd02cd95d279d.device:0xc00030df10 dev-disk-by\x2dpartuuid-d7a34286\x2deb76\x2d498c\x2db059\x2d69d78792cb2d.device:0xc000309c90 dev-disk-by\x2dpartuuid-dec61052\x2d415b\x2d41cb\x2d9dee\x2dc388acaedc9b.device:0xc00030b028 dev-disk-by\x2dpartuuid-f6b8b07f\x2dacab\x2d4ef5\x2dad07\x2d3801da86361f.device:0xc000309570 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1.device:0xc000307008 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart1.device:0xc00030ca48 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart10.device:0xc000307430 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart11.device:0xc00030ae60 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart12.device:0xc000309868 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart2.device:0xc00030d460 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart3.device:0xc00030f210 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart4.device:0xc000309a30 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart5.device:0xc00030cd40 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart6.device:0xc0003094d8 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart7.device:0xc00030d920 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart8.device:0xc000308a28 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart9.device:0xc00030bc08 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d2.device:0xc00030dc18 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d2\x2dpart1.device:0xc000309148 dev-disk-by\x2duuid-26e4b5d3\x2d6a65\x2d4ed6\x2d86d8\x2df3223d9c9e91.device:0xc00030ac98 dev-disk-by\x2duuid-3fda7e53\x2d959a\x2d4e9c\x2dac60\x2d17c29a7f8d01.device:0xc00030e890 dev-disk-by\x2duuid-582db298\x2db784\x2d4967\x2d927e\x2d8075bb78fb06.device:0xc00030e338 dev-disk-by\x2duuid-79CA\x2d69E8.device:0xc000308bf0 dev-disk-by\x2duuid-ab2695d4\x2dc79b\x2d47f1\x2dba1b\x2dfd0da33ad10e.device:0xc00030f178 dev-disk-by\x2duuid-e57e7486\x2ddee8\x2d4ad1\x2d9caf\x2d8e1fcf8f11a6.device:0xc00030ee80 dev-dm\x2d0.device:0xc00030bca0 dev-hugepages.mount:0xc000306428 dev-loop0.device:0xc000308860 dev-loop1.device:0xc000306e40 dev-mqueue.mount:0xc0003087c8 dev-nvme0n1.device:0xc000309e58 dev-nvme0n1p1.device:0xc0003078f0 dev-nvme0n1p10.device:0xc00030db80 dev-nvme0n1p11.device:0xc00030a1e8 dev-nvme0n1p12.device:0xc00030c1f8 dev-nvme0n1p2.device:0xc000307b50 dev-nvme0n1p3.device:0xc0003081d8 dev-nvme0n1p4.device:0xc000307ab8 dev-nvme0n1p5.device:0xc00030d628 dev-nvme0n1p6.device:0xc00030dcb0 dev-nvme0n1p7.device:0xc00030bdd0 dev-nvme0n1p8.device:0xc00030ede8 dev-nvme0n1p9.device:0xc000306098 dev-nvme0n2.device:0xc000308270 dev-nvme0n2p1.device:0xc000307560 dev-ttyS0.device:0xc00030d168 dev-ttyS1.device:0xc000306720 dev-ttyS2.device:0xc00030e9c0 dev-ttyS3.device:0xc000307e48 disable-kexec-load.service:0xc000307988 early-boot-config.service:0xc0003067b8 emergency.service:0xc00030cae0 emergency.target:0xc00030ad30 etc-cni.mount:0xc00030ec20 first-boot-complete.target:0xc00030f6d0 getty.target:0xc00030f508 host-containerd.service:0xc00030f470 host-containers@admin.service:0xc000307398 host-containers@kubeadm-bootstrap.service:0xc00030b158 init.scope:0xc000307138 initrd-root-fs.target:0xc000308010 isdn.service:0xc00030b618 kmod-static-nodes.service:0xc000308140 kubelet.service:0xc00030e760 ldconfig.service:0xc00030ef18 load-crash-kernel.service:0xc000307c80 local-fs-pre.target:0xc00030d758 local-fs.target:0xc000309b60 local-var-lib-bottlerocket.mount:0xc00030a7d8 local-var-lib-kernel\x2ddevel-lower.mount:0xc00030c328 local.mount:0xc00030c588 mark-successful-boot.service:0xc0003068e8 metricdog.service:0xc000308438 metricdog.timer:0xc000308c88 migrator.service:0xc00030d200 mnt.mount:0xc00030b7e0 modprobe@configfs.service:0xc00030b1f0 modprobe@fuse.service:0xc00030a150 multi-user.target:0xc00030a870 network-online.target:0xc000309ac8 network-pre.target:0xc00030da50 network.target:0xc00030e928 openvswitch.service:0xc00030c458 opt.mount:0xc000307d18 paths.target:0xc00030c3c0 preconfigured.target:0xc0003083a0 prepare-boot.service:0xc00030af90 prepare-local.service:0xc00030f3d8 rdma.service:0xc00030cc10 remote-fs-pre.target:0xc00030c160 remote-fs.target:0xc00030f048 rescue.service:0xc00030e040 rescue.target:0xc00030c750 run-host\x2dcontainerd-io.containerd.runtime.v2.task-default-admin-rootfs.mount:0xc00030c0c8 run-host\x2dcontainerd-io.containerd.runtime.v2.task-default-kubeadm\x2dbootstrap-rootfs.mount:0xc00030c7e8 runtime.slice:0xc0003074c8 selinux-policy-files.service:0xc00030c880 send-boot-success.service:0xc00030ce70 set-hostname.service:0xc00030cf08 settings-applier.service:0xc00030a020 shutdown.target:0xc00030efb0 slices.target:0xc00030a740 sockets.target:0xc00030e630 storewolf.service:0xc0003084d0 sundog.service:0xc00030d298 swap.target:0xc000307690 sys-devices-pci0000:00-0000:00:15.0-0000:03:00.0-net-eth0.device:0xc0003062f8 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p1.device:0xc00030b910 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p10.device:0xc00030d590 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p11.device:0xc0003091e0 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p12.device:0xc000307db0 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p2.device:0xc00030b3b8 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p3.device:0xc00030eb88 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p4.device:0xc000309310 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p5.device:0xc00030de78 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p6.device:0xc000308ac0 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p7.device:0xc00030a4e0 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p8.device:0xc0003097d0 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p9.device:0xc000306ed8 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1.device:0xc0003093a8 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n2-nvme0n2p1.device:0xc000309608 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n2.device:0xc000307300 sys-devices-platform-serial8250-tty-ttyS0.device:0xc000308ee8 sys-devices-platform-serial8250-tty-ttyS1.device:0xc00030d7f0 sys-devices-platform-serial8250-tty-ttyS2.device:0xc00030aa38 sys-devices-platform-serial8250-tty-ttyS3.device:0xc00030c620 sys-devices-virtual-block-dm\x2d0.device:0xc000308600 sys-devices-virtual-block-loop0.device:0xc00030d038 sys-devices-virtual-block-loop1.device:0xc00030dae8 sys-fs-fuse-connections.mount:0xc000307f78 sys-kernel-config.mount:0xc00030e2a0 sys-kernel-debug.mount:0xc00030b878 sys-kernel-tracing.mount:0xc00030cb78 sys-module-configfs.device:0xc00030ac00 sys-module-fuse.device:0xc00030dde0 sys-subsystem-net-devices-eth0.device:0xc000308990 sysinit.target:0xc000306f70 syslog.service:0xc00030d6c0 syslog.socket:0xc0003077c0 sysroot.mount:0xc000308308 system-host\x2dcontainers.slice:0xc00030f340 system-modprobe.slice:0xc00030b288 system.slice:0xc00030e208 systemd-fsck-root.service:0xc00030a3b0 systemd-hwdb-update.service:0xc00030f5a0 systemd-initctl.service:0xc00030ba40 systemd-initctl.socket:0xc00030f768 systemd-journal-catalog-update.service:0xc000306d10 systemd-journal-flush.service:0xc00030b450 systemd-journald-audit.socket:0xc000309bf8 systemd-journald-dev-log.socket:0xc000306130 systemd-journald.service:0xc000309d28 systemd-journald.socket:0xc00030b9a8 systemd-machine-id-commit.service:0xc00030d888 systemd-modules-load.service:0xc00030ab68 systemd-pstore.service:0xc000309ef0 systemd-random-seed.service:0xc00030c6b8 systemd-remount-fs.service:0xc00030bf00 systemd-repart.service:0xc00030c290 systemd-sysctl.service:0xc000307a20 systemd-sysusers.service:0xc000309278 systemd-tmpfiles-clean.service:0xc00030bf98 systemd-tmpfiles-clean.timer:0xc000309f88 systemd-tmpfiles-setup-dev.service:0xc000307ee0 systemd-tmpfiles-setup.service:0xc000306688 systemd-udev-settle.service:0xc000306980 systemd-udev-trigger.service:0xc000306be0 systemd-udevd-control.socket:0xc000306390 systemd-udevd-kernel.socket:0xc000306da8 systemd-udevd.service:0xc00030c9b0 systemd-update-done.service:0xc00030a0b8 time-set.target:0xc000307858 timers.target:0xc00030e3d0 tmp.mount:0xc000306000 umount.target:0xc00030f638 var-lib-bottlerocket.mount:0xc00030be68 var-lib-kernel\x2ddevel-lower.mount:0xc00030d4f8 var.mount:0xc0003070a0 vmtoolsd.service:0xc00030a578 wicked.service:0xc000309738 wickedd-auto4.service:0xc0003061c8 wickedd-dhcp4.service:0xc000308f80 wickedd-dhcp6.service:0xc000306ab0 wickedd-nanny.service:0xc000307728 wickedd.service:0xc000306850 x86_64\x2dbottlerocket\x2dlinux\x2dgnu-sys\x2droot-usr-share-licenses.mount:0xc000309900 x86_64\x2dbottlerocket\x2dlinux\x2dgnu-sys\x2droot-usr-src-kernels.mount:0xc000306b48]
Nov 19 09:09:25 172.20.0.110 host-ctr[2838]: Received status change: map[kubelet.service:0xc0003c6760]
Nov 19 09:09:31 172.20.0.110 host-ctr[3082]: time="2021-11-19T09:09:31Z" level=warning msg="ecr-public: failed to get authorization token, falling back to default resolver (unauthenticated pull)"
Nov 19 09:09:32 172.20.0.110 host-ctr[3082]: time="2021-11-19T09:09:32Z" level=info msg="pulled image successfully" img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:09:32 172.20.0.110 host-ctr[3082]: time="2021-11-19T09:09:32Z" level=info msg="unpacking image..." img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:09:32 172.20.0.110 host-ctr[2838]: Received status change: map[kubelet.service:0xc00050a7f8 run-r843e1fbb959a4b0c9fb1b7c857c3d632.scope:0xc0005051e0]
Nov 19 09:09:33 172.20.0.110 host-ctr[2838]: Received status change: map[run-r843e1fbb959a4b0c9fb1b7c857c3d632.scope:<nil>]
Nov 19 09:09:44 172.20.0.110 host-ctr[2838]: Received status change: map[kubelet.service:0xc000232760]
Nov 19 09:09:49 172.20.0.110 host-ctr[2838]: Received status change: map[kubelet.service:0xc0003e4760]
Nov 19 09:09:55 172.20.0.110 host-ctr[3129]: time="2021-11-19T09:09:55Z" level=warning msg="ecr-public: failed to get authorization token, falling back to default resolver (unauthenticated pull)"
Nov 19 09:09:56 172.20.0.110 host-ctr[3129]: time="2021-11-19T09:09:56Z" level=info msg="pulled image successfully" img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:09:56 172.20.0.110 host-ctr[3129]: time="2021-11-19T09:09:56Z" level=info msg="unpacking image..." img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:09:56 172.20.0.110 host-ctr[2838]: Received status change: map[kubelet.service:0xc0003ba760]
Nov 19 09:10:07 172.20.0.110 host-ctr[2838]: Received status change: map[kubelet.service:0xc0003ba760]
Nov 19 09:10:07 172.20.0.110 host-ctr[2838]: kubelet.service service is active and running
Nov 19 09:10:07 172.20.0.110 host-ctr[2838]: Bottlerocket bootstrap pre-requisites complete
Nov 19 09:10:07 172.20.0.110 host-ctr[2838]: Initiating bottlerocket bootstrap
Nov 19 09:10:07 172.20.0.110 host-ctr[2838]: Acquired lock for bootstrap
Nov 19 09:10:07 172.20.0.110 host-ctr[2838]: Parsing userdata
Nov 19 09:10:07 172.20.0.110 host-ctr[2838]: &{WriteFiles:[{Path:/var/lib/etcd/pki/ca.crt Owner:root:root Permissions:0640 Content:-----BEGIN CERTIFICATE-----
Nov 19 09:10:07 172.20.0.110 host-ctr[2838]: xxxxxxxxxxxxxxxxx
Nov 19 09:10:07 172.20.0.110 host-ctr[2838]: -----END CERTIFICATE-----
Nov 19 09:10:07 172.20.0.110 host-ctr[2838]: } {Path:/var/lib/etcd/pki/ca.key Owner:root:root Permissions:0600 Content:-----BEGIN RSA PRIVATE KEY-----
Nov 19 09:10:07 172.20.0.110 host-ctr[2838]: xxxxxxxxxxxxxxxxx
Nov 19 09:10:07 172.20.0.110 host-ctr[2838]: -----END RSA PRIVATE KEY-----
Nov 19 09:10:07 172.20.0.110 host-ctr[2838]: } {Path:/run/cluster-api/placeholder Owner:root:root Permissions:0640 Content:This placeholder file is used to create the /run/cluster-api sub directory in a way that is compatible with both Linux and Windows (mkdir -p /run/cluster-api does not work with Windows)}] RunCmd:EtcdadmJoin public.ecr.aws/eks-distro/etcd-io/etcd 3.4.16-eks-1-21-6 https://172.20.0.109:2379}
Nov 19 09:10:07 172.20.0.110 host-ctr[2838]: Using etcdadm support by CAPI
Nov 19 09:10:07 172.20.0.110 host-ctr[2838]: Writing userdata write files
Nov 19 09:10:07 172.20.0.110 host-ctr[2838]: Running etcdadm join phases
Nov 19 09:10:07 172.20.0.110 host-ctr[2838]: Running etcdadm join stop phase
Nov 19 09:10:07 172.20.0.110 host-ctr[2838]: Phase command output:
Nov 19 09:10:07 172.20.0.110 host-ctr[2838]: --------
Nov 19 09:10:07 172.20.0.110 host-ctr[2838]: --------
Nov 19 09:10:07 172.20.0.110 host-ctr[2838]: Running etcdadm join certificates phase
Nov 19 09:10:09 172.20.0.110 host-ctr[2838]: Phase command output:
Nov 19 09:10:09 172.20.0.110 host-ctr[2838]: --------
Nov 19 09:10:09 172.20.0.110 host-ctr[2838]: time="2021-11-19T09:10:07Z" level=info msg="[certificates] creating PKI assets"
Nov 19 09:10:09 172.20.0.110 host-ctr[2838]: time="2021-11-19T09:10:07Z" level=info msg="creating a self signed etcd CA certificate and key files"
Nov 19 09:10:09 172.20.0.110 host-ctr[2838]: [certificates] Using the existing ca certificate and key.
Nov 19 09:10:09 172.20.0.110 host-ctr[2838]: time="2021-11-19T09:10:08Z" level=info msg="creating a new server certificate and key files for etcd"
Nov 19 09:10:09 172.20.0.110 host-ctr[2838]: [certificates] Generated server certificate and key.
Nov 19 09:10:09 172.20.0.110 host-ctr[2838]: [certificates] server serving cert is signed for DNS names [] and IPs [172.20.0.110 172.20.0.110 127.0.0.1]
Nov 19 09:10:09 172.20.0.110 host-ctr[2838]: time="2021-11-19T09:10:08Z" level=info msg="creating a new certificate and key files for etcd peering"
Nov 19 09:10:09 172.20.0.110 host-ctr[2838]: [certificates] Generated peer certificate and key.
Nov 19 09:10:09 172.20.0.110 host-ctr[2838]: [certificates] peer serving cert is signed for DNS names [] and IPs [172.20.0.110 172.20.0.110]
Nov 19 09:10:09 172.20.0.110 host-ctr[2838]: time="2021-11-19T09:10:09Z" level=info msg="creating a new client certificate for the etcdctl"
Nov 19 09:10:09 172.20.0.110 host-ctr[2838]: [certificates] Generated etcdctl-etcd-client certificate and key.
Nov 19 09:10:09 172.20.0.110 host-ctr[2838]: time="2021-11-19T09:10:09Z" level=info msg="creating a new client certificate for the apiserver calling etcd"
Nov 19 09:10:09 172.20.0.110 host-ctr[2838]: [certificates] Generated apiserver-etcd-client certificate and key.
Nov 19 09:10:09 172.20.0.110 host-ctr[2838]: [certificates] valid certificates and keys now exist in "/var/lib/etcd/pki"
Nov 19 09:10:09 172.20.0.110 host-ctr[2838]: --------
Nov 19 09:10:09 172.20.0.110 host-ctr[2838]: Running etcdadm join membership phase
Nov 19 09:10:14 172.20.0.110 host-ctr[2838]: Phase command output:
Nov 19 09:10:14 172.20.0.110 host-ctr[2838]: --------
Nov 19 09:10:14 172.20.0.110 host-ctr[2838]: time="2021-11-19T09:10:09Z" level=info msg="[membership] Checking if this member was added"
Nov 19 09:10:14 172.20.0.110 host-ctr[2838]: {"level":"warn","ts":"2021-11-19T09:10:14.706Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-cf199536-cf03-45a1-9008-285f6c7bcf92/172.20.0.109:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = context deadline exceeded"}
Nov 19 09:10:14 172.20.0.110 host-ctr[2838]: time="2021-11-19T09:10:14Z" level=fatal msg="[membership] error listing members: context deadline exceeded"
Nov 19 09:10:14 172.20.0.110 host-ctr[2838]: --------
Nov 19 09:10:14 172.20.0.110 host-ctr[2838]: Error running bootstrapper cmd: error running etcdadm phase 'join membership', out:
Nov 19 09:10:14 172.20.0.110 host-ctr[2838]:  time="2021-11-19T09:10:09Z" level=info msg="[membership] Checking if this member was added"
Nov 19 09:10:14 172.20.0.110 host-ctr[2838]: {"level":"warn","ts":"2021-11-19T09:10:14.706Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-cf199536-cf03-45a1-9008-285f6c7bcf92/172.20.0.109:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = context deadline exceeded"}
Nov 19 09:10:14 172.20.0.110 host-ctr[2838]: time="2021-11-19T09:10:14Z" level=fatal msg="[membership] error listing members: context deadline exceeded"
Nov 19 09:10:14 172.20.0.110 host-ctr[2838]: : exit status 1
Nov 19 09:10:14 172.20.0.110 host-ctr[2838]: time="2021-11-19T09:10:14Z" level=info msg="container task exited" code=1
Nov 19 09:10:14 172.20.0.110 host-ctr[2838]: time="2021-11-19T09:10:14Z" level=fatal msg="Container kubeadm-bootstrap exited with non-zero status"
Nov 19 09:10:19 172.20.0.110 host-ctr[3192]: time="2021-11-19T09:10:19Z" level=warning msg="ecr-public: failed to get authorization token, falling back to default resolver (unauthenticated pull)"
Nov 19 09:10:20 172.20.0.110 host-ctr[3192]: time="2021-11-19T09:10:20Z" level=info msg="pulled image successfully" img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:10:20 172.20.0.110 host-ctr[3192]: time="2021-11-19T09:10:20Z" level=info msg="unpacking image..." img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:10:43 172.20.0.110 host-ctr[3254]: time="2021-11-19T09:10:43Z" level=warning msg="ecr-public: failed to get authorization token, falling back to default resolver (unauthenticated pull)"
Nov 19 09:10:43 172.20.0.110 host-ctr[3254]: time="2021-11-19T09:10:43Z" level=info msg="pulled image successfully" img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:10:43 172.20.0.110 host-ctr[3254]: time="2021-11-19T09:10:43Z" level=info msg="unpacking image..." img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:11:06 172.20.0.110 host-ctr[3285]: time="2021-11-19T09:11:06Z" level=warning msg="ecr-public: failed to get authorization token, falling back to default resolver (unauthenticated pull)"
Nov 19 09:11:06 172.20.0.110 host-ctr[3294]: time="2021-11-19T09:11:06Z" level=warning msg="ecr-public: failed to get authorization token, falling back to default resolver (unauthenticated pull)"
Nov 19 09:11:07 172.20.0.110 host-ctr[3285]: time="2021-11-19T09:11:07Z" level=info msg="pulled image successfully" img="public.ecr.aws/eks-anywhere/bottlerocket-bootstrap:v1-21-6-eks-a-4"
Nov 19 09:11:07 172.20.0.110 host-ctr[3285]: time="2021-11-19T09:11:07Z" level=info msg="unpacking image..." img="public.ecr.aws/eks-anywhere/bottlerocket-bootstrap:v1-21-6-eks-a-4"
Nov 19 09:11:07 172.20.0.110 host-ctr[3285]: time="2021-11-19T09:11:07Z" level=info msg="Container does not exist, proceeding to create it" ctr-id=kubeadm-bootstrap
Nov 19 09:11:07 172.20.0.110 host-ctr[3285]: time="2021-11-19T09:11:07Z" level=info msg="container task does not exist, proceeding to create it" container-id=kubeadm-bootstrap
Nov 19 09:11:07 172.20.0.110 host-ctr[3285]: Waiting for bottlerocket boot to complete...
Nov 19 09:11:07 172.20.0.110 host-ctr[3285]: Waiting for multi-user.target to come up
Nov 19 09:11:07 172.20.0.110 host-ctr[3285]: time="2021-11-19T09:11:07Z" level=info msg="successfully started container task"
Nov 19 09:11:07 172.20.0.110 host-ctr[3285]: Created dbus connection to talk to systemd
Nov 19 09:11:07 172.20.0.110 host-ctr[3285]: Received status change: map[-.mount:0xc000311800 -.slice:0xc00030fd48 SuSEfirewall2_init.service:0xc00030ab58 acpid.service:0xc00030d4e8 activate-configured.service:0xc00030cdc8 activate-multi-user.service:0xc0003107f8 apiserver.service:0xc00030ae50 audit-rules.service:0xc00030edd8 basic.target:0xc00030f330 blockdev@dev-loop0.target:0xc00030f3c8 blockdev@dev-loop1.target:0xc000308a18 blockdev@dev-nvme0n1p12.target:0xc00030c908 blockdev@dev-nvme0n1p3.target:0xc00030d0c0 blockdev@dev-nvme0n2p1.target:0xc00030c610 boot.mount:0xc0003095f8 chronyd.service:0xc00030a8f8 configured.target:0xc00030a730 containerd.service:0xc00030d6b0 dbus-broker.service:0xc00030b998 dbus.socket:0xc00030eca8 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000.device:0xc00030b440 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart1.device:0xc00030e4f0 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart10.device:0xc00030a0a8 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart11.device:0xc00030d580 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart12.device:0xc00030adb8 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart2.device:0xc000310a58 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart3.device:0xc000309268 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart4.device:0xc0003110e0 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart5.device:0xc00030db70 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart6.device:0xc00030c9a0 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart7.device:0xc000310500 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart8.device:0xc00030b6a0 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart9.device:0xc00030f9b8 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001.device:0xc00030bdc0 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart1.device:0xc00030b018 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart10.device:0xc00030cad0 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart11.device:0xc00030cef8 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart12.device:0xc000309be8 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart2.device:0xc00030dd38 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart3.device:0xc00030d748 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart4.device:0xc00030e030 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart5.device:0xc00030e918 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart6.device:0xc0003091d0 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart7.device:0xc00030c6a8 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart8.device:0xc000310af0 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart9.device:0xc00030c280 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000002.device:0xc000308260 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000002\x2dpart1.device:0xc00030c318 dev-disk-by\x2dpartlabel-BIOS\x2dBOOT.device:0xc0003100d8 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dBOOT\x2dA.device:0xc00030ffa8 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dBOOT\x2dB.device:0xc0003106c8 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dDATA.device:0xc000308c78 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dHASH\x2dA.device:0xc000308558 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dHASH\x2dB.device:0xc00030efa0 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dPRIVATE.device:0xc0003085f0 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dRESERVED\x2dA.device:0xc000310170 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dRESERVED\x2dB.device:0xc00030dad8 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dROOT\x2dA.device:0xc000310d50 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dROOT\x2dB.device:0xc00030b0b0 dev-disk-by\x2dpartlabel-EFI\x2dBACKUP.device:0xc00030a698 dev-disk-by\x2dpartlabel-EFI\x2dSYSTEM.device:0xc0003112a8 dev-disk-by\x2dpartuuid-33ae178a\x2df579\x2d4cb3\x2db462\x2d8a61ab80a15f.device:0xc00030a568 dev-disk-by\x2dpartuuid-3cc2e645\x2df1e5\x2d45fe\x2dad17\x2de339d8a4c583.device:0xc000310598 dev-disk-by\x2dpartuuid-456d72a9\x2df299\x2d4bac\x2daec0\x2d963b3edf4e1e.device:0xc00030d320 dev-disk-by\x2dpartuuid-496c628c\x2d5d33\x2d4f19\x2d9e08\x2d850333b40b0c.device:0xc00030c448 dev-disk-by\x2dpartuuid-8900e6d2\x2d72e9\x2d4916\x2d8f3d\x2de68cc512fa6f.device:0xc000310cb8 dev-disk-by\x2dpartuuid-93beed59\x2df3bb\x2d4a06\x2d8540\x2d59a48281dac8.device:0xc0003084c0 dev-disk-by\x2dpartuuid-a107a78e\x2dde3c\x2d4c3f\x2db85f\x2d384eee820b61.device:0xc00030f0d0 dev-disk-by\x2dpartuuid-af935829\x2d5ee4\x2d4974\x2d9f6a\x2d2048e060d98e.device:0xc000310468 dev-disk-by\x2dpartuuid-b51ed158\x2d126b\x2d436a\x2db319\x2d6a28fd171e09.device:0xc00030ad20 dev-disk-by\x2dpartuuid-b8f3dd15\x2d4e23\x2d467f\x2d96ad\x2dd02cd95d279d.device:0xc00030ff10 dev-disk-by\x2dpartuuid-d7a34286\x2deb76\x2d498c\x2db059\x2d69d78792cb2d.device:0xc00030bc90 dev-disk-by\x2dpartuuid-dec61052\x2d415b\x2d41cb\x2d9dee\x2dc388acaedc9b.device:0xc00030d028 dev-disk-by\x2dpartuuid-f6b8b07f\x2dacab\x2d4ef5\x2dad07\x2d3801da86361f.device:0xc00030b570 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1.device:0xc000309008 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart1.device:0xc00030ea48 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart10.device:0xc000309430 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart11.device:0xc00030ce60 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart12.device:0xc00030b868 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart2.device:0xc00030f460 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart3.device:0xc000311210 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart4.device:0xc00030ba30 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart5.device:0xc00030ed40 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart6.device:0xc00030b4d8 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart7.device:0xc00030f920 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart8.device:0xc00030aa28 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart9.device:0xc00030dc08 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d2.device:0xc00030fc18 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d2\x2dpart1.device:0xc00030b148 dev-disk-by\x2duuid-26e4b5d3\x2d6a65\x2d4ed6\x2d86d8\x2df3223d9c9e91.device:0xc00030cc98 dev-disk-by\x2duuid-3fda7e53\x2d959a\x2d4e9c\x2dac60\x2d17c29a7f8d01.device:0xc000310890 dev-disk-by\x2duuid-582db298\x2db784\x2d4967\x2d927e\x2d8075bb78fb06.device:0xc000310338 dev-disk-by\x2duuid-79CA\x2d69E8.device:0xc00030abf0 dev-disk-by\x2duuid-ab2695d4\x2dc79b\x2d47f1\x2dba1b\x2dfd0da33ad10e.device:0xc000311178 dev-disk-by\x2duuid-e57e7486\x2ddee8\x2d4ad1\x2d9caf\x2d8e1fcf8f11a6.device:0xc000310e80 dev-dm\x2d0.device:0xc00030dca0 dev-hugepages.mount:0xc000308428 dev-loop0.device:0xc00030a860 dev-loop1.device:0xc000308e40 dev-mqueue.mount:0xc00030a7c8 dev-nvme0n1.device:0xc00030be58 dev-nvme0n1p1.device:0xc0003098f0 dev-nvme0n1p10.device:0xc00030fb80 dev-nvme0n1p11.device:0xc00030c1e8 dev-nvme0n1p12.device:0xc00030e1f8 dev-nvme0n1p2.device:0xc000309b50 dev-nvme0n1p3.device:0xc00030a1d8 dev-nvme0n1p4.device:0xc000309ab8 dev-nvme0n1p5.device:0xc00030f628 dev-nvme0n1p6.device:0xc00030fcb0 dev-nvme0n1p7.device:0xc00030ddd0 dev-nvme0n1p8.device:0xc000310de8 dev-nvme0n1p9.device:0xc000308098 dev-nvme0n2.device:0xc00030a270 dev-nvme0n2p1.device:0xc000309560 dev-ttyS0.device:0xc00030f168 dev-ttyS1.device:0xc000308720 dev-ttyS2.device:0xc0003109c0 dev-ttyS3.device:0xc000309e48 disable-kexec-load.service:0xc000309988 early-boot-config.service:0xc0003087b8 emergency.service:0xc00030eae0 emergency.target:0xc00030cd30 etc-cni.mount:0xc000310c20 first-boot-complete.target:0xc0003116d0 getty.target:0xc000311508 host-containerd.service:0xc000311470 host-containers@admin.service:0xc000309398 host-containers@kubeadm-bootstrap.service:0xc00030d158 init.scope:0xc000309138 initrd-root-fs.target:0xc00030a010 isdn.service:0xc00030d618 kmod-static-nodes.service:0xc00030a140 kubelet.service:0xc000310760 ldconfig.service:0xc000310f18 load-crash-kernel.service:0xc000309c80 local-fs-pre.target:0xc00030f758 local-fs.target:0xc00030bb60 local-var-lib-bottlerocket.mount:0xc00030c7d8 local-var-lib-kernel\x2ddevel-lower.mount:0xc00030e328 local.mount:0xc00030e588 mark-successful-boot.service:0xc0003088e8 metricdog.service:0xc00030a438 metricdog.timer:0xc00030ac88 migrator.service:0xc00030f200 mnt.mount:0xc00030d7e0 modprobe@configfs.service:0xc00030d1f0 modprobe@fuse.service:0xc00030c150 multi-user.target:0xc00030c870 network-online.target:0xc00030bac8 network-pre.target:0xc00030fa50 network.target:0xc000310928 openvswitch.service:0xc00030e458 opt.mount:0xc000309d18 paths.target:0xc00030e3c0 preconfigured.target:0xc00030a3a0 prepare-boot.service:0xc00030cf90 prepare-local.service:0xc0003113d8 rdma.service:0xc00030ec10 remote-fs-pre.target:0xc00030e160 remote-fs.target:0xc000311048 rescue.service:0xc000310040 rescue.target:0xc00030e750 run-host\x2dcontainerd-io.containerd.runtime.v2.task-default-admin-rootfs.mount:0xc00030e0c8 run-host\x2dcontainerd-io.containerd.runtime.v2.task-default-kubeadm\x2dbootstrap-rootfs.mount:0xc00030e7e8 runtime.slice:0xc0003094c8 selinux-policy-files.service:0xc00030e880 send-boot-success.service:0xc00030ee70 set-hostname.service:0xc00030ef08 settings-applier.service:0xc00030c020 shutdown.target:0xc000310fb0 slices.target:0xc00030c740 sockets.target:0xc000310630 storewolf.service:0xc00030a4d0 sundog.service:0xc00030f298 swap.target:0xc000309690 sys-devices-pci0000:00-0000:00:15.0-0000:03:00.0-net-eth0.device:0xc0003082f8 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p1.device:0xc00030d910 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p10.device:0xc00030f590 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p11.device:0xc00030b1e0 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p12.device:0xc000309db0 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p2.device:0xc00030d3b8 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p3.device:0xc000310b88 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p4.device:0xc00030b310 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p5.device:0xc00030fe78 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p6.device:0xc00030aac0 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p7.device:0xc00030c4e0 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p8.device:0xc00030b7d0 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p9.device:0xc000308ed8 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1.device:0xc00030b3a8 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n2-nvme0n2p1.device:0xc00030b608 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n2.device:0xc000309300 sys-devices-platform-serial8250-tty-ttyS0.device:0xc00030aee8 sys-devices-platform-serial8250-tty-ttyS1.device:0xc00030f7f0 sys-devices-platform-serial8250-tty-ttyS2.device:0xc00030ca38 sys-devices-platform-serial8250-tty-ttyS3.device:0xc00030e620 sys-devices-virtual-block-dm\x2d0.device:0xc00030a600 sys-devices-virtual-block-loop0.device:0xc00030f038 sys-devices-virtual-block-loop1.device:0xc00030fae8 sys-fs-fuse-connections.mount:0xc000309f78 sys-kernel-config.mount:0xc0003102a0 sys-kernel-debug.mount:0xc00030d878 sys-kernel-tracing.mount:0xc00030eb78 sys-module-configfs.device:0xc00030cc00 sys-module-fuse.device:0xc00030fde0 sys-subsystem-net-devices-eth0.device:0xc00030a990 sysinit.target:0xc000308f70 syslog.service:0xc00030f6c0 syslog.socket:0xc0003097c0 sysroot.mount:0xc00030a308 system-host\x2dcontainers.slice:0xc000311340 system-modprobe.slice:0xc00030d288 system.slice:0xc000310208 systemd-fsck-root.service:0xc00030c3b0 systemd-hwdb-update.service:0xc0003115a0 systemd-initctl.service:0xc00030da40 systemd-initctl.socket:0xc000311768 systemd-journal-catalog-update.service:0xc000308d10 systemd-journal-flush.service:0xc00030d450 systemd-journald-audit.socket:0xc00030bbf8 systemd-journald-dev-log.socket:0xc000308130 systemd-journald.service:0xc00030bd28 systemd-journald.socket:0xc00030d9a8 systemd-machine-id-commit.service:0xc00030f888 systemd-modules-load.service:0xc00030cb68 systemd-pstore.service:0xc00030bef0 systemd-random-seed.service:0xc00030e6b8 systemd-remount-fs.service:0xc00030df00 systemd-repart.service:0xc00030e290 systemd-sysctl.service:0xc000309a20 systemd-sysusers.service:0xc00030b278 systemd-tmpfiles-clean.service:0xc00030df98 systemd-tmpfiles-clean.timer:0xc00030bf88 systemd-tmpfiles-setup-dev.service:0xc000309ee0 systemd-tmpfiles-setup.service:0xc000308688 systemd-udev-settle.service:0xc000308980 systemd-udev-trigger.service:0xc000308be0 systemd-udevd-control.socket:0xc000308390 systemd-udevd-kernel.socket:0xc000308da8 systemd-udevd.service:0xc00030e9b0 systemd-update-done.service:0xc00030c0b8 time-set.target:0xc000309858 timers.target:0xc0003103d0 tmp.mount:0xc000308000 umount.target:0xc000311638 var-lib-bottlerocket.mount:0xc00030de68 var-lib-kernel\x2ddevel-lower.mount:0xc00030f4f8 var.mount:0xc0003090a0 vmtoolsd.service:0xc00030c578 wicked.service:0xc00030b738 wickedd-auto4.service:0xc0003081c8 wickedd-dhcp4.service:0xc00030af80 wickedd-dhcp6.service:0xc000308ab0 wickedd-nanny.service:0xc000309728 wickedd.service:0xc000308850 x86_64\x2dbottlerocket\x2dlinux\x2dgnu-sys\x2droot-usr-share-licenses.mount:0xc00030b900 x86_64\x2dbottlerocket\x2dlinux\x2dgnu-sys\x2droot-usr-src-kernels.mount:0xc000308b48]
Nov 19 09:11:07 172.20.0.110 host-ctr[3285]: multi-user.target service is active and running
Nov 19 09:11:07 172.20.0.110 host-ctr[3285]: Waiting for kubelet.service to come up
Nov 19 09:11:07 172.20.0.110 host-ctr[3285]: Created dbus connection to talk to systemd
Nov 19 09:11:07 172.20.0.110 host-ctr[3285]: Received status change: map[-.mount:0xc0002bf800 -.slice:0xc0002bdd48 SuSEfirewall2_init.service:0xc0002b8b58 acpid.service:0xc0002bb4e8 activate-configured.service:0xc0002badc8 activate-multi-user.service:0xc0002be7f8 apiserver.service:0xc0002b8e50 audit-rules.service:0xc0002bcdd8 basic.target:0xc0002bd330 blockdev@dev-loop0.target:0xc0002bd3c8 blockdev@dev-loop1.target:0xc0002b6a18 blockdev@dev-nvme0n1p12.target:0xc0002ba908 blockdev@dev-nvme0n1p3.target:0xc0002bb0c0 blockdev@dev-nvme0n2p1.target:0xc0002ba610 boot.mount:0xc0002b75f8 chronyd.service:0xc0002b88f8 configured.target:0xc0002b8730 containerd.service:0xc0002bb6b0 dbus-broker.service:0xc0002b9998 dbus.socket:0xc0002bcca8 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000.device:0xc0002b9440 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart1.device:0xc0002bc4f0 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart10.device:0xc0002b80a8 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart11.device:0xc0002bb580 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart12.device:0xc0002b8db8 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart2.device:0xc0002bea58 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart3.device:0xc0002b7268 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart4.device:0xc0002bf0e0 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart5.device:0xc0002bbb70 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart6.device:0xc0002ba9a0 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart7.device:0xc0002be500 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart8.device:0xc0002b96a0 dev-disk-by\x2did-nvme\x2dVMware_Virtual_NVMe_Disk_VMWare_NVME_0000\x2dpart9.device:0xc0002bd9b8 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001.device:0xc0002b9dc0 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart1.device:0xc0002b9018 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart10.device:0xc0002baad0 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart11.device:0xc0002baef8 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart12.device:0xc0002b7be8 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart2.device:0xc0002bbd38 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart3.device:0xc0002bb748 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart4.device:0xc0002bc030 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart5.device:0xc0002bc918 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart6.device:0xc0002b71d0 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart7.device:0xc0002ba6a8 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart8.device:0xc0002beaf0 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000001\x2dpart9.device:0xc0002ba280 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000002.device:0xc0002b6260 dev-disk-by\x2did-nvme\x2dnvme.15ad\x2d564d57617265204e564d455f30303030\x2d564d77617265205669727475616c204e564d65204469736b\x2d00000002\x2dpart1.device:0xc0002ba318 dev-disk-by\x2dpartlabel-BIOS\x2dBOOT.device:0xc0002be0d8 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dBOOT\x2dA.device:0xc0002bdfa8 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dBOOT\x2dB.device:0xc0002be6c8 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dDATA.device:0xc0002b6c78 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dHASH\x2dA.device:0xc0002b6558 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dHASH\x2dB.device:0xc0002bcfa0 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dPRIVATE.device:0xc0002b65f0 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dRESERVED\x2dA.device:0xc0002be170 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dRESERVED\x2dB.device:0xc0002bbad8 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dROOT\x2dA.device:0xc0002bed50 dev-disk-by\x2dpartlabel-BOTTLEROCKET\x2dROOT\x2dB.device:0xc0002b90b0 dev-disk-by\x2dpartlabel-EFI\x2dBACKUP.device:0xc0002b8698 dev-disk-by\x2dpartlabel-EFI\x2dSYSTEM.device:0xc0002bf2a8 dev-disk-by\x2dpartuuid-33ae178a\x2df579\x2d4cb3\x2db462\x2d8a61ab80a15f.device:0xc0002b8568 dev-disk-by\x2dpartuuid-3cc2e645\x2df1e5\x2d45fe\x2dad17\x2de339d8a4c583.device:0xc0002be598 dev-disk-by\x2dpartuuid-456d72a9\x2df299\x2d4bac\x2daec0\x2d963b3edf4e1e.device:0xc0002bb320 dev-disk-by\x2dpartuuid-496c628c\x2d5d33\x2d4f19\x2d9e08\x2d850333b40b0c.device:0xc0002ba448 dev-disk-by\x2dpartuuid-8900e6d2\x2d72e9\x2d4916\x2d8f3d\x2de68cc512fa6f.device:0xc0002becb8 dev-disk-by\x2dpartuuid-93beed59\x2df3bb\x2d4a06\x2d8540\x2d59a48281dac8.device:0xc0002b64c0 dev-disk-by\x2dpartuuid-a107a78e\x2dde3c\x2d4c3f\x2db85f\x2d384eee820b61.device:0xc0002bd0d0 dev-disk-by\x2dpartuuid-af935829\x2d5ee4\x2d4974\x2d9f6a\x2d2048e060d98e.device:0xc0002be468 dev-disk-by\x2dpartuuid-b51ed158\x2d126b\x2d436a\x2db319\x2d6a28fd171e09.device:0xc0002b8d20 dev-disk-by\x2dpartuuid-b8f3dd15\x2d4e23\x2d467f\x2d96ad\x2dd02cd95d279d.device:0xc0002bdf10 dev-disk-by\x2dpartuuid-d7a34286\x2deb76\x2d498c\x2db059\x2d69d78792cb2d.device:0xc0002b9c90 dev-disk-by\x2dpartuuid-dec61052\x2d415b\x2d41cb\x2d9dee\x2dc388acaedc9b.device:0xc0002bb028 dev-disk-by\x2dpartuuid-f6b8b07f\x2dacab\x2d4ef5\x2dad07\x2d3801da86361f.device:0xc0002b9570 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1.device:0xc0002b7008 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart1.device:0xc0002bca48 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart10.device:0xc0002b7430 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart11.device:0xc0002bae60 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart12.device:0xc0002b9868 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart2.device:0xc0002bd460 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart3.device:0xc0002bf210 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart4.device:0xc0002b9a30 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart5.device:0xc0002bcd40 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart6.device:0xc0002b94d8 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart7.device:0xc0002bd920 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart8.device:0xc0002b8a28 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d1\x2dpart9.device:0xc0002bbc08 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d2.device:0xc0002bdc18 dev-disk-by\x2dpath-pci\x2d0000:0b:00.0\x2dnvme\x2d2\x2dpart1.device:0xc0002b9148 dev-disk-by\x2duuid-26e4b5d3\x2d6a65\x2d4ed6\x2d86d8\x2df3223d9c9e91.device:0xc0002bac98 dev-disk-by\x2duuid-3fda7e53\x2d959a\x2d4e9c\x2dac60\x2d17c29a7f8d01.device:0xc0002be890 dev-disk-by\x2duuid-582db298\x2db784\x2d4967\x2d927e\x2d8075bb78fb06.device:0xc0002be338 dev-disk-by\x2duuid-79CA\x2d69E8.device:0xc0002b8bf0 dev-disk-by\x2duuid-ab2695d4\x2dc79b\x2d47f1\x2dba1b\x2dfd0da33ad10e.device:0xc0002bf178 dev-disk-by\x2duuid-e57e7486\x2ddee8\x2d4ad1\x2d9caf\x2d8e1fcf8f11a6.device:0xc0002bee80 dev-dm\x2d0.device:0xc0002bbca0 dev-hugepages.mount:0xc0002b6428 dev-loop0.device:0xc0002b8860 dev-loop1.device:0xc0002b6e40 dev-mqueue.mount:0xc0002b87c8 dev-nvme0n1.device:0xc0002b9e58 dev-nvme0n1p1.device:0xc0002b78f0 dev-nvme0n1p10.device:0xc0002bdb80 dev-nvme0n1p11.device:0xc0002ba1e8 dev-nvme0n1p12.device:0xc0002bc1f8 dev-nvme0n1p2.device:0xc0002b7b50 dev-nvme0n1p3.device:0xc0002b81d8 dev-nvme0n1p4.device:0xc0002b7ab8 dev-nvme0n1p5.device:0xc0002bd628 dev-nvme0n1p6.device:0xc0002bdcb0 dev-nvme0n1p7.device:0xc0002bbdd0 dev-nvme0n1p8.device:0xc0002bede8 dev-nvme0n1p9.device:0xc0002b6098 dev-nvme0n2.device:0xc0002b8270 dev-nvme0n2p1.device:0xc0002b7560 dev-ttyS0.device:0xc0002bd168 dev-ttyS1.device:0xc0002b6720 dev-ttyS2.device:0xc0002be9c0 dev-ttyS3.device:0xc0002b7e48 disable-kexec-load.service:0xc0002b7988 early-boot-config.service:0xc0002b67b8 emergency.service:0xc0002bcae0 emergency.target:0xc0002bad30 etc-cni.mount:0xc0002bec20 first-boot-complete.target:0xc0002bf6d0 getty.target:0xc0002bf508 host-containerd.service:0xc0002bf470 host-containers@admin.service:0xc0002b7398 host-containers@kubeadm-bootstrap.service:0xc0002bb158 init.scope:0xc0002b7138 initrd-root-fs.target:0xc0002b8010 isdn.service:0xc0002bb618 kmod-static-nodes.service:0xc0002b8140 kubelet.service:0xc0002be760 ldconfig.service:0xc0002bef18 load-crash-kernel.service:0xc0002b7c80 local-fs-pre.target:0xc0002bd758 local-fs.target:0xc0002b9b60 local-var-lib-bottlerocket.mount:0xc0002ba7d8 local-var-lib-kernel\x2ddevel-lower.mount:0xc0002bc328 local.mount:0xc0002bc588 mark-successful-boot.service:0xc0002b68e8 metricdog.service:0xc0002b8438 metricdog.timer:0xc0002b8c88 migrator.service:0xc0002bd200 mnt.mount:0xc0002bb7e0 modprobe@configfs.service:0xc0002bb1f0 modprobe@fuse.service:0xc0002ba150 multi-user.target:0xc0002ba870 network-online.target:0xc0002b9ac8 network-pre.target:0xc0002bda50 network.target:0xc0002be928 openvswitch.service:0xc0002bc458 opt.mount:0xc0002b7d18 paths.target:0xc0002bc3c0 preconfigured.target:0xc0002b83a0 prepare-boot.service:0xc0002baf90 prepare-local.service:0xc0002bf3d8 rdma.service:0xc0002bcc10 remote-fs-pre.target:0xc0002bc160 remote-fs.target:0xc0002bf048 rescue.service:0xc0002be040 rescue.target:0xc0002bc750 run-host\x2dcontainerd-io.containerd.runtime.v2.task-default-admin-rootfs.mount:0xc0002bc0c8 run-host\x2dcontainerd-io.containerd.runtime.v2.task-default-kubeadm\x2dbootstrap-rootfs.mount:0xc0002bc7e8 runtime.slice:0xc0002b74c8 selinux-policy-files.service:0xc0002bc880 send-boot-success.service:0xc0002bce70 set-hostname.service:0xc0002bcf08 settings-applier.service:0xc0002ba020 shutdown.target:0xc0002befb0 slices.target:0xc0002ba740 sockets.target:0xc0002be630 storewolf.service:0xc0002b84d0 sundog.service:0xc0002bd298 swap.target:0xc0002b7690 sys-devices-pci0000:00-0000:00:15.0-0000:03:00.0-net-eth0.device:0xc0002b62f8 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p1.device:0xc0002bb910 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p10.device:0xc0002bd590 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p11.device:0xc0002b91e0 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p12.device:0xc0002b7db0 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p2.device:0xc0002bb3b8 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p3.device:0xc0002beb88 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p4.device:0xc0002b9310 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p5.device:0xc0002bde78 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p6.device:0xc0002b8ac0 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p7.device:0xc0002ba4e0 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p8.device:0xc0002b97d0 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1-nvme0n1p9.device:0xc0002b6ed8 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n1.device:0xc0002b93a8 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n2-nvme0n2p1.device:0xc0002b9608 sys-devices-pci0000:00-0000:00:16.0-0000:0b:00.0-nvme-nvme0-nvme0n2.device:0xc0002b7300 sys-devices-platform-serial8250-tty-ttyS0.device:0xc0002b8ee8 sys-devices-platform-serial8250-tty-ttyS1.device:0xc0002bd7f0 sys-devices-platform-serial8250-tty-ttyS2.device:0xc0002baa38 sys-devices-platform-serial8250-tty-ttyS3.device:0xc0002bc620 sys-devices-virtual-block-dm\x2d0.device:0xc0002b8600 sys-devices-virtual-block-loop0.device:0xc0002bd038 sys-devices-virtual-block-loop1.device:0xc0002bdae8 sys-fs-fuse-connections.mount:0xc0002b7f78 sys-kernel-config.mount:0xc0002be2a0 sys-kernel-debug.mount:0xc0002bb878 sys-kernel-tracing.mount:0xc0002bcb78 sys-module-configfs.device:0xc0002bac00 sys-module-fuse.device:0xc0002bdde0 sys-subsystem-net-devices-eth0.device:0xc0002b8990 sysinit.target:0xc0002b6f70 syslog.service:0xc0002bd6c0 syslog.socket:0xc0002b77c0 sysroot.mount:0xc0002b8308 system-host\x2dcontainers.slice:0xc0002bf340 system-modprobe.slice:0xc0002bb288 system.slice:0xc0002be208 systemd-fsck-root.service:0xc0002ba3b0 systemd-hwdb-update.service:0xc0002bf5a0 systemd-initctl.service:0xc0002bba40 systemd-initctl.socket:0xc0002bf768 systemd-journal-catalog-update.service:0xc0002b6d10 systemd-journal-flush.service:0xc0002bb450 systemd-journald-audit.socket:0xc0002b9bf8 systemd-journald-dev-log.socket:0xc0002b6130 systemd-journald.service:0xc0002b9d28 systemd-journald.socket:0xc0002bb9a8 systemd-machine-id-commit.service:0xc0002bd888 systemd-modules-load.service:0xc0002bab68 systemd-pstore.service:0xc0002b9ef0 systemd-random-seed.service:0xc0002bc6b8 systemd-remount-fs.service:0xc0002bbf00 systemd-repart.service:0xc0002bc290 systemd-sysctl.service:0xc0002b7a20 systemd-sysusers.service:0xc0002b9278 systemd-tmpfiles-clean.service:0xc0002bbf98 systemd-tmpfiles-clean.timer:0xc0002b9f88 systemd-tmpfiles-setup-dev.service:0xc0002b7ee0 systemd-tmpfiles-setup.service:0xc0002b6688 systemd-udev-settle.service:0xc0002b6980 systemd-udev-trigger.service:0xc0002b6be0 systemd-udevd-control.socket:0xc0002b6390 systemd-udevd-kernel.socket:0xc0002b6da8 systemd-udevd.service:0xc0002bc9b0 systemd-update-done.service:0xc0002ba0b8 time-set.target:0xc0002b7858 timers.target:0xc0002be3d0 tmp.mount:0xc0002b6000 umount.target:0xc0002bf638 var-lib-bottlerocket.mount:0xc0002bbe68 var-lib-kernel\x2ddevel-lower.mount:0xc0002bd4f8 var.mount:0xc0002b70a0 vmtoolsd.service:0xc0002ba578 wicked.service:0xc0002b9738 wickedd-auto4.service:0xc0002b61c8 wickedd-dhcp4.service:0xc0002b8f80 wickedd-dhcp6.service:0xc0002b6ab0 wickedd-nanny.service:0xc0002b7728 wickedd.service:0xc0002b6850 x86_64\x2dbottlerocket\x2dlinux\x2dgnu-sys\x2droot-usr-share-licenses.mount:0xc0002b9900 x86_64\x2dbottlerocket\x2dlinux\x2dgnu-sys\x2droot-usr-src-kernels.mount:0xc0002b6b48]
Nov 19 09:11:07 172.20.0.110 host-ctr[3294]: time="2021-11-19T09:11:07Z" level=info msg="pulled image successfully" img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:11:07 172.20.0.110 host-ctr[3294]: time="2021-11-19T09:11:07Z" level=info msg="unpacking image..." img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:11:08 172.20.0.110 host-ctr[3285]: Received status change: map[kubelet.service:0xc00045a760]
Nov 19 09:11:19 172.20.0.110 host-ctr[3285]: Received status change: map[kubelet.service:0xc0003d0760]
Nov 19 09:11:25 172.20.0.110 host-ctr[3285]: Received status change: map[kubelet.service:0xc000488760]
Nov 19 09:11:30 172.20.0.110 host-ctr[3370]: time="2021-11-19T09:11:30Z" level=warning msg="ecr-public: failed to get authorization token, falling back to default resolver (unauthenticated pull)"
Nov 19 09:11:31 172.20.0.110 host-ctr[3370]: time="2021-11-19T09:11:31Z" level=info msg="pulled image successfully" img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:11:31 172.20.0.110 host-ctr[3370]: time="2021-11-19T09:11:31Z" level=info msg="unpacking image..." img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:11:32 172.20.0.110 host-ctr[3285]: Received status change: map[kubelet.service:0xc000424760]
Nov 19 09:11:43 172.20.0.110 host-ctr[3285]: Received status change: map[kubelet.service:0xc000356760]
Nov 19 09:11:48 172.20.0.110 host-ctr[3285]: Received status change: map[kubelet.service:0xc000018760]
Nov 19 09:11:54 172.20.0.110 host-ctr[3420]: time="2021-11-19T09:11:54Z" level=warning msg="ecr-public: failed to get authorization token, falling back to default resolver (unauthenticated pull)"
Nov 19 09:11:55 172.20.0.110 host-ctr[3420]: time="2021-11-19T09:11:55Z" level=info msg="pulled image successfully" img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:11:55 172.20.0.110 host-ctr[3420]: time="2021-11-19T09:11:55Z" level=info msg="unpacking image..." img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:11:55 172.20.0.110 host-ctr[3285]: Received status change: map[kubelet.service:0xc000572760]
Nov 19 09:12:07 172.20.0.110 host-ctr[3285]: Received status change: map[kubelet.service:0xc000252760]
Nov 19 09:12:12 172.20.0.110 host-ctr[3285]: Received status change: map[kubelet.service:0xc000420760]
Nov 19 09:12:18 172.20.0.110 host-ctr[3466]: time="2021-11-19T09:12:18Z" level=warning msg="ecr-public: failed to get authorization token, falling back to default resolver (unauthenticated pull)"
Nov 19 09:12:18 172.20.0.110 host-ctr[3466]: time="2021-11-19T09:12:18Z" level=info msg="pulled image successfully" img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:12:18 172.20.0.110 host-ctr[3466]: time="2021-11-19T09:12:18Z" level=info msg="unpacking image..." img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:12:19 172.20.0.110 host-ctr[3285]: Received status change: map[kubelet.service:0xc000392760]
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: Received status change: map[kubelet.service:0xc000408760]
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: kubelet.service service is active and running
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: Bottlerocket bootstrap pre-requisites complete
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: Initiating bottlerocket bootstrap
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: Cannot acquire lock, another instance of bootstrap is already running
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: Parsing userdata
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: &{WriteFiles:[{Path:/var/lib/etcd/pki/ca.crt Owner:root:root Permissions:0640 Content:-----BEGIN CERTIFICATE-----
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: xxxxxxxxxxxxxxxxx
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: -----END CERTIFICATE-----
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: } {Path:/var/lib/etcd/pki/ca.key Owner:root:root Permissions:0600 Content:-----BEGIN RSA PRIVATE KEY-----
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: xxxxxxxxxxxxxxxxx
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: -----END RSA PRIVATE KEY-----
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: } {Path:/run/cluster-api/placeholder Owner:root:root Permissions:0640 Content:This placeholder file is used to create the /run/cluster-api sub directory in a way that is compatible with both Linux and Windows (mkdir -p /run/cluster-api does not work with Windows)}] RunCmd:EtcdadmJoin public.ecr.aws/eks-distro/etcd-io/etcd 3.4.16-eks-1-21-6 https://172.20.0.109:2379}
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: Using etcdadm support by CAPI
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: Writing userdata write files
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: Running etcdadm join phases
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: Running etcdadm join stop phase
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: Phase command output:
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: --------
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: --------
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: Running etcdadm join certificates phase
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: time="2021-11-19T09:12:30Z" level=info msg="received signal: terminated"
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: time="2021-11-19T09:12:30Z" level=info msg="container task exited" code=143
Nov 19 09:12:30 172.20.0.110 host-ctr[3285]: time="2021-11-19T09:12:30Z" level=fatal msg="Container kubeadm-bootstrap exited with non-zero status"
Nov 19 09:12:41 172.20.0.110 host-ctr[3565]: time="2021-11-19T09:12:41Z" level=warning msg="ecr-public: failed to get authorization token, falling back to default resolver (unauthenticated pull)"
Nov 19 09:12:42 172.20.0.110 host-ctr[3565]: time="2021-11-19T09:12:42Z" level=info msg="pulled image successfully" img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:12:42 172.20.0.110 host-ctr[3565]: time="2021-11-19T09:12:42Z" level=info msg="unpacking image..." img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:13:05 172.20.0.110 host-ctr[3622]: time="2021-11-19T09:13:05Z" level=warning msg="ecr-public: failed to get authorization token, falling back to default resolver (unauthenticated pull)"
Nov 19 09:13:06 172.20.0.110 host-ctr[3622]: time="2021-11-19T09:13:06Z" level=info msg="pulled image successfully" img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:13:06 172.20.0.110 host-ctr[3622]: time="2021-11-19T09:13:06Z" level=info msg="unpacking image..." img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:13:29 172.20.0.110 host-ctr[3679]: time="2021-11-19T09:13:29Z" level=warning msg="ecr-public: failed to get authorization token, falling back to default resolver (unauthenticated pull)"
Nov 19 09:13:30 172.20.0.110 host-ctr[3679]: time="2021-11-19T09:13:30Z" level=info msg="pulled image successfully" img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:13:30 172.20.0.110 host-ctr[3679]: time="2021-11-19T09:13:30Z" level=info msg="unpacking image..." img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:13:51 172.20.0.110 host-ctr[2837]: Accepted publickey for ec2-user from 172.20.0.1 port 40304 ssh2: RSA SHA256:pmd2kBX33n8HLYK6lwVLumXorN0PwH2I9pvI0Cc+2Hs
Nov 19 09:13:52 172.20.0.110 host-ctr[3733]: time="2021-11-19T09:13:52Z" level=warning msg="ecr-public: failed to get authorization token, falling back to default resolver (unauthenticated pull)"
Nov 19 09:13:53 172.20.0.110 host-ctr[3733]: time="2021-11-19T09:13:53Z" level=info msg="pulled image successfully" img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
Nov 19 09:13:53 172.20.0.110 host-ctr[3733]: time="2021-11-19T09:13:53Z" level=info msg="unpacking image..." img="public.ecr.aws/eks-distro/kubernetes/pause:v1.21.2-eks-1-21-6"
vignesh-goutham commented 2 years ago

We have put out a new release of EKS-A. Please give it a try and let us know if you see any issues.

danbudris commented 2 years ago

Closing this issue as stale; please re-open or file a new issue if you continue to run into problems with the newest releases. Thank you!