search

dyrnq / kubeadm-vagrant

Run kubernetes cluster with kubeadm on vagrant.
1 stars 5 forks source link

none of the public keys "sha256:3ade64c0af415bad8bfa9f06857379a00d1d4d4d2188be367347fe0fbe895193" are pinned #44

Open dyrnq opened 2 years ago

dyrnq commented 2 years ago 
kubeadm reset -f && kubeadm join 192.168.122.216:6443 --token ayngk7.m1555duk5x2i3ctt --discovery-token-ca-cert-hash sha256:9bfae35eddc5f4c006c9ea36bc033b539ab1fd88725ca70cc4c6290c8f8f6d92 --ignore-preflight-errors=SystemVerification -v9
[preflight] Running pre-flight checks
W0814 08:29:13.596977  566624 removeetcdmember.go:80] [reset] No kubeadm config, using etcd pod spec to get data directory
[reset] No etcd config found. Assuming external etcd
[reset] Please, manually reset etcd to prevent further issues
[reset] Stopping the kubelet service
[reset] Unmounting mounted directories in "/var/lib/kubelet"
[reset] Deleting contents of config directories: [/etc/kubernetes/manifests /etc/kubernetes/pki]
[reset] Deleting files: [/etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/bootstrap-kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf]
[reset] Deleting contents of stateful directories: [/var/lib/kubelet /var/lib/dockershim /var/run/kubernetes /var/lib/cni]

The reset process does not clean CNI configuration. To do so, you must remove /etc/cni/net.d

The reset process does not reset or clean up iptables rules or IPVS tables.
If you wish to reset iptables, you must do so manually by using the "iptables" command.

If your cluster was setup to utilize IPVS, run ipvsadm --clear (or similar)
to reset your system's IPVS tables.

The reset process does not clean your kubeconfig files and you must remove them manually.
Please, check the contents of the $HOME/.kube/config file.
I0814 08:29:13.651629  566636 join.go:413] [preflight] found NodeName empty; using OS hostname as NodeName
I0814 08:29:13.651710  566636 initconfiguration.go:117] detected and using CRI socket: /var/run/dockershim.sock
[preflight] Running pre-flight checks
I0814 08:29:13.651765  566636 preflight.go:92] [preflight] Running general checks
I0814 08:29:13.651800  566636 checks.go:283] validating the existence of file /etc/kubernetes/kubelet.conf
I0814 08:29:13.651806  566636 checks.go:283] validating the existence of file /etc/kubernetes/bootstrap-kubelet.conf
I0814 08:29:13.651811  566636 checks.go:107] validating the container runtime
I0814 08:29:13.729862  566636 checks.go:133] validating if the "docker" service is enabled and active
I0814 08:29:13.740011  566636 checks.go:332] validating the contents of file /proc/sys/net/bridge/bridge-nf-call-iptables
I0814 08:29:13.740047  566636 checks.go:332] validating the contents of file /proc/sys/net/ipv4/ip_forward
I0814 08:29:13.740064  566636 checks.go:654] validating whether swap is enabled or not
I0814 08:29:13.740077  566636 checks.go:373] validating the presence of executable conntrack
I0814 08:29:13.740091  566636 checks.go:373] validating the presence of executable ip
I0814 08:29:13.740312  566636 checks.go:373] validating the presence of executable iptables
I0814 08:29:13.740324  566636 checks.go:373] validating the presence of executable mount
I0814 08:29:13.740428  566636 checks.go:373] validating the presence of executable nsenter
I0814 08:29:13.740586  566636 checks.go:373] validating the presence of executable ebtables
I0814 08:29:13.740641  566636 checks.go:373] validating the presence of executable ethtool
I0814 08:29:13.740649  566636 checks.go:373] validating the presence of executable socat
I0814 08:29:13.740655  566636 checks.go:373] validating the presence of executable tc
I0814 08:29:13.740660  566636 checks.go:373] validating the presence of executable touch
I0814 08:29:13.740673  566636 checks.go:521] running all checks
[preflight] The system verification failed. Printing the output from the verification:
KERNEL_VERSION: 3.10.0-327.28.3.el7.x86_64
CONFIG_NAMESPACES: enabled
CONFIG_NET_NS: enabled
CONFIG_PID_NS: enabled
CONFIG_IPC_NS: enabled
CONFIG_UTS_NS: enabled
CONFIG_CGROUPS: enabled
CONFIG_CGROUP_CPUACCT: enabled
CONFIG_CGROUP_DEVICE: enabled
CONFIG_CGROUP_FREEZER: enabled
CONFIG_CGROUP_PIDS: not set
CONFIG_CGROUP_SCHED: enabled
CONFIG_CPUSETS: enabled
CONFIG_MEMCG: enabled
CONFIG_INET: enabled
CONFIG_EXT4_FS: enabled (as module)
CONFIG_PROC_FS: enabled
CONFIG_NETFILTER_XT_TARGET_REDIRECT: enabled (as module)
CONFIG_NETFILTER_XT_MATCH_COMMENT: enabled (as module)
CONFIG_FAIR_GROUP_SCHED: enabled
CONFIG_OVERLAY_FS: enabled (as module)
CONFIG_AUFS_FS: not set - Required for aufs.
CONFIG_BLK_DEV_DM: enabled (as module)
CONFIG_CFS_BANDWIDTH: enabled
CONFIG_CGROUP_HUGETLB: enabled
CONFIG_SECCOMP: enabled
CONFIG_SECCOMP_FILTER: enabled
DOCKER_VERSION: 20.10.17
DOCKER_GRAPH_DRIVER: devicemapper
OS: Linux
CGROUPS_CPU: enabled
CGROUPS_CPUACCT: enabled
CGROUPS_CPUSET: enabled
CGROUPS_DEVICES: enabled
CGROUPS_FREEZER: enabled
CGROUPS_MEMORY: enabled
CGROUPS_PIDS: missing
CGROUPS_HUGETLB: enabled
    [WARNING SystemVerification]: unexpected kernel config: CONFIG_CGROUP_PIDS
    [WARNING SystemVerification]: missing required cgroups: pids
I0814 08:29:13.809311  566636 checks.go:404] checking whether the given node name is valid and reachable using net.LookupHost
I0814 08:29:13.809645  566636 checks.go:620] validating kubelet version
I0814 08:29:13.854412  566636 checks.go:133] validating if the "kubelet" service is enabled and active
I0814 08:29:13.859145  566636 checks.go:206] validating availability of port 10250
I0814 08:29:13.859330  566636 checks.go:283] validating the existence of file /etc/kubernetes/pki/ca.crt
I0814 08:29:13.859342  566636 checks.go:433] validating if the connectivity type is via proxy or direct
I0814 08:29:13.859368  566636 join.go:530] [preflight] Discovering cluster-info
I0814 08:29:13.859394  566636 token.go:80] [discovery] Created cluster-info discovery client, requesting info from "192.168.122.216:6443"
I0814 08:29:13.859816  566636 round_trippers.go:466] curl -v -XGET  -H "Accept: application/json, */*" -H "User-Agent: kubeadm/v1.23.9 (linux/amd64) kubernetes/c1de2d7" 'https://192.168.122.216:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s'
I0814 08:29:13.860225  566636 round_trippers.go:510] HTTP Trace: Dial to tcp:192.168.122.216:6443 succeed
I0814 08:29:13.866850  566636 round_trippers.go:570] HTTP Statistics: DNSLookup 0 ms Dial 0 ms TLSHandshake 2 ms ServerProcessing 4 ms Duration 7 ms
I0814 08:29:13.866866  566636 round_trippers.go:577] Response Headers:
I0814 08:29:13.866872  566636 round_trippers.go:580]     X-Kubernetes-Pf-Prioritylevel-Uid: e2c9f56c-f58e-4f98-b891-28ec5e78703e
I0814 08:29:13.866875  566636 round_trippers.go:580]     Content-Length: 2393
I0814 08:29:13.866878  566636 round_trippers.go:580]     Date: Sun, 14 Aug 2022 00:29:13 GMT
I0814 08:29:13.866881  566636 round_trippers.go:580]     Audit-Id: 33d4d445-b7cf-49a9-b60f-8e110c00969e
I0814 08:29:13.866885  566636 round_trippers.go:580]     Cache-Control: no-cache, private
I0814 08:29:13.866888  566636 round_trippers.go:580]     Content-Type: application/json
I0814 08:29:13.866891  566636 round_trippers.go:580]     X-Kubernetes-Pf-Flowschema-Uid: 37a1291d-d61c-4e57-9b0f-da4c7384be85
I0814 08:29:13.866951  566636 request.go:1181] Response Body: {"kind":"ConfigMap","apiVersion":"v1","metadata":{"name":"cluster-info","namespace":"kube-public","uid":"5ffb2f3d-b496-4f2c-b591-cec964f8631d","resourceVersion":"449","creationTimestamp":"2022-08-14T00:20:12Z","managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time":"2022-08-14T00:20:12Z","fieldsType":"FieldsV1","fieldsV1":{"f:data":{".":{},"f:kubeconfig":{}}}},{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2022-08-14T00:20:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:data":{"f:jws-kubeconfig-ayngk7":{}}}}]},"data":{"jws-kubeconfig-ayngk7":"eyJhbGciOiJIUzI1NiIsImtpZCI6ImF5bmdrNyJ9..awe-OGqwtQaDx91Pz1NrI6AxjFPXL5OaY5LMew5pb6s","kubeconfig":"apiVersion: v1\nclusters:\n- cluster:\n    certificate-authority-data: LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUMvakNDQWVhZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeU1EZ3hOREF3TWpBd01sb1hEVE15TURneE1UQXdNakF3TWxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTUVhCkUvc0VpeHBNeWN1YkFkdTZDN1VaWEFvUjFadEdkOUFGNTJNNzhHa1NBMkJrdUk4QWo5ME92U000T3NEek8xMFEKaTJtVEZrS2llRGhNZkNaL0VkR0NDbkU5Yk93OUNoV3N2SzVjQ242Q3ZHRzk1cjdGVnVBZytwWUVkYmpHSE14YQpMNVphbTZaeURiRGZHZExocWFyT2RsLzh3SEszQ2xRZnJtSHFWeS9ZcDFzblJhNFAzSXRSeHJTK29oVklyUEt6ClR1KysvMHBGdmRpcXNyVjJUWVhRYUhiVnV0a1NvN2czL1V3S1lDT3VVdmZ4WUtRcThvU2E4aHdNMDNGRnB1ZFIKVDc5cmdMOEc4Q2hsVXBDRHE5WDA4dXRCUlgwVHFtMWwvcHZ4bU5aV3VLbTVxajh5YlVzNGREeWFoeXFwS3dORwpwdytGWEwxb2JXZHdTVUt4a3ZNQ0F3RUFBYU5aTUZjd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZCOUtPOTFlMElxTHdXS2lwSlFUSDJaS3JWZnlNQlVHQTFVZEVRUU8KTUF5Q0NtdDFZbVZ5Ym1WMFpYTXdEUVlKS29aSWh2Y05BUUVMQlFBRGdnRUJBRTVpRGYzTHZtUW9kVDF2RWcvZApHWVNFRnMwQ3VZTzNxcnEyVkhMdnNZUkpHZldPZ25rcUdiQ2xhZEl6b0FvcHE2TFpJcmxlUnZoQy9ua2h2YW5LCm1KM0hiMWNDY3JENXNuSEh4TG4rcTBhcUErWkZBeHZaYnBkTTRoM01pcDBWenU1OFBVa1hMWWR4SVBHbnVQaUIKZnZndU9BRFZqeU5rcjJsVlhmSlJvQTBQaVVveHVpZDBRcEF3L2tEakIvSHFUbkdmdVRzT1RTZ3JtK0RNUlB4bgpKQk5ZNU1BT29RVlJEcFVuRkh2UzBGVjluYkxJWVU2VEhqa1drclAyTDBOVkh6WjlNSVI1UTVGaW9xZVd1ZjVMCk53VW5obHdaZVpUYmRlVlQybW9oaEFVb1JqUU56OTJSb2RvbWMvS2lZcTgreTdXeUFTOExLbENWVWhIYzdCZlMKV2c4PQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==\n    server: https://192.168.122.216:6443\n  name: \"\"\ncontexts: null\ncurrent-context: \"\"\nkind: Config\npreferences: {}\nusers: null\n"}}
none of the public keys "sha256:3ade64c0af415bad8bfa9f06857379a00d1d4d4d2188be367347fe0fbe895193" are pinned
k8s.io/kubernetes/cmd/kubeadm/app/util/pubkeypin.(*Set).CheckAny
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/util/pubkeypin/pubkeypin.go:83
k8s.io/kubernetes/cmd/kubeadm/app/discovery/token.validateClusterCA
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/discovery/token/token.go:188
k8s.io/kubernetes/cmd/kubeadm/app/discovery/token.retrieveValidatedConfigInfo
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/discovery/token/token.go:110
k8s.io/kubernetes/cmd/kubeadm/app/discovery/token.RetrieveValidatedConfigInfo
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/discovery/token/token.go:53
k8s.io/kubernetes/cmd/kubeadm/app/discovery.DiscoverValidatedKubeConfig
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/discovery/discovery.go:83
k8s.io/kubernetes/cmd/kubeadm/app/discovery.For
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/discovery/discovery.go:43
k8s.io/kubernetes/cmd/kubeadm/app/cmd.(*joinData).TLSBootstrapCfg
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:531
k8s.io/kubernetes/cmd/kubeadm/app/cmd.(*joinData).InitCfg
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:541
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/join.runPreflight
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/join/preflight.go:97
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run.func1
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:234
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).visitAll
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:421
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:207
k8s.io/kubernetes/cmd/kubeadm/app/cmd.newCmdJoin.func1
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:178
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).execute
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:856
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).ExecuteC
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:974
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).Execute
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:902
k8s.io/kubernetes/cmd/kubeadm/app.Run
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/kubeadm.go:50
main.main
    _output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/kubeadm.go:25
runtime.main
    /usr/local/go/src/runtime/proc.go:255
runtime.goexit
    /usr/local/go/src/runtime/asm_amd64.s:1581
cluster CA found in cluster-info ConfigMap is invalid
k8s.io/kubernetes/cmd/kubeadm/app/discovery/token.validateClusterCA
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/discovery/token/token.go:190
k8s.io/kubernetes/cmd/kubeadm/app/discovery/token.retrieveValidatedConfigInfo
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/discovery/token/token.go:110
k8s.io/kubernetes/cmd/kubeadm/app/discovery/token.RetrieveValidatedConfigInfo
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/discovery/token/token.go:53
k8s.io/kubernetes/cmd/kubeadm/app/discovery.DiscoverValidatedKubeConfig
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/discovery/discovery.go:83
k8s.io/kubernetes/cmd/kubeadm/app/discovery.For
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/discovery/discovery.go:43
k8s.io/kubernetes/cmd/kubeadm/app/cmd.(*joinData).TLSBootstrapCfg
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:531
k8s.io/kubernetes/cmd/kubeadm/app/cmd.(*joinData).InitCfg
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:541
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/join.runPreflight
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/join/preflight.go:97
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run.func1
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:234
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).visitAll
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:421
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:207
k8s.io/kubernetes/cmd/kubeadm/app/cmd.newCmdJoin.func1
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:178
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).execute
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:856
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).ExecuteC
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:974
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).Execute
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:902
k8s.io/kubernetes/cmd/kubeadm/app.Run
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/kubeadm.go:50
main.main
    _output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/kubeadm.go:25
runtime.main
    /usr/local/go/src/runtime/proc.go:255
runtime.goexit
    /usr/local/go/src/runtime/asm_amd64.s:1581
couldn't validate the identity of the API Server
k8s.io/kubernetes/cmd/kubeadm/app/discovery.For
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/discovery/discovery.go:45
k8s.io/kubernetes/cmd/kubeadm/app/cmd.(*joinData).TLSBootstrapCfg
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:531
k8s.io/kubernetes/cmd/kubeadm/app/cmd.(*joinData).InitCfg
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:541
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/join.runPreflight
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/join/preflight.go:97
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run.func1
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:234
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).visitAll
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:421
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:207
k8s.io/kubernetes/cmd/kubeadm/app/cmd.newCmdJoin.func1
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:178
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).execute
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:856
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).ExecuteC
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:974
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).Execute
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:902
k8s.io/kubernetes/cmd/kubeadm/app.Run
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/kubeadm.go:50
main.main
    _output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/kubeadm.go:25
runtime.main
    /usr/local/go/src/runtime/proc.go:255
runtime.goexit
    /usr/local/go/src/runtime/asm_amd64.s:1581
error execution phase preflight
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run.func1
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:235
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).visitAll
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:421
k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:207
k8s.io/kubernetes/cmd/kubeadm/app/cmd.newCmdJoin.func1
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/cmd/join.go:178
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).execute
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:856
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).ExecuteC
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:974
k8s.io/kubernetes/vendor/github.com/spf13/cobra.(*Command).Execute
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/spf13/cobra/command.go:902
k8s.io/kubernetes/cmd/kubeadm/app.Run
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/app/kubeadm.go:50
main.main
    _output/dockerized/go/src/k8s.io/kubernetes/cmd/kubeadm/kubeadm.go:25
runtime.main
    /usr/local/go/src/runtime/proc.go:255
runtime.goexit
    /usr/local/go/src/runtime/asm_amd64.s:1581
dyrnq commented 2 years ago 
kubectl -n kube-public get cm cluster-info -o jsonpath='{.data.kubeconfig}' | grep certificate-authority-data | awk -F ":" '{print $2}' | xargs | base64 -d

cat /etc/kubernetes/pki/ca.crt

check two files same?

certhash=`openssl x509 -pubkey -in /etc/kubernetes/pki/ca.crt | openssl rsa -pubin -outform der 2>/dev/null | openssl dgst -sha256 -hex | sed 's/^.* //'`
echo "kubeadm join 192.168.122.216:6443 --token  ayngk7.m1555duk5x2i3ctt --discovery-token-ca-cert-hash sha256:$certhash"
dyrnq commented 2 years ago 
kubeadm init phase kubeconfig admin
I0814 08:55:51.502333  566771 version.go:255] remote version is much newer: v1.24.3; falling back to: stable-1.23
error execution phase kubeconfig/admin: couldn't create a kubeconfig; the CA files couldn't be loaded: failed to load certificate: couldn't load the certificate file /etc/kubernetes/pki/ca.crt: open /etc/kubernetes/pki/ca.crt: no such file or directory
To see the stack trace of this error execute with --v=5 or higher