tiup v1.10.0 gets `Error: failed to fetch cpu-arch or kernel-name: executor.ssh.execute_failed`

pingcap / tiup

A component manager for TiDB

Apache License 2.0

427 stars 313 forks source link

Bug Report

Please answer these questions before submitting your issue. Thanks!

What did you do?

tiup cluster check  ./topology.yaml -i ~/.ssh/keys/yahondatest.pem

What did you expect to see? It should check the node configuration as tiup v1.9.4 does.

$ tiup cluster:v1.9.4 check ./topology.yaml -i ~/.ssh/keys/yahondatest.pem The component `cluster` version v1.9.4 is not installed; downloading from repository. download https://tiup-mirrors.pingcap.com/cluster-v1.9.4-linux-amd64.tar.gz 7.81 MiB / 7.81 MiB 100.00% ? MiB/s Starting component `cluster`: /home/ec2-user/.tiup/components/cluster/v1.9.4/tiup-cluster check ./topology.yaml -i /home/ec2-user/.ssh/keys/yahondatest.pem + Detect CPU Arch - Detecting node 10.0.131.156 ... ⠙ Shell: host=10.0.131.156, sudo=false, command=`uname -m` + Detect CPU Arch - Detecting node 10.0.131.156 ... Done - Detecting node 10.0.138.103 ... Done - Detecting node 10.0.128.24 ... Done - Detecting node 10.0.138.132 ... Done - Detecting node 10.0.137.245 ... Done - Detecting node 10.0.141.19 ... Done - Detecting node 10.0.134.85 ... Done + Download necessary tools - Downloading check tools for linux/amd64 ... Done + Collect basic system information - Getting system info of 10.0.131.156:22 ... ⠴ CopyComponent: component=insight, version=, remote=10.0.131.156:/tmp/tiup os=linux, arch=amd64 - Getting system info of 10.0.138.103:22 ... ⠴ CopyComponent: component=insight, version=, remote=10.0.138.103:/tmp/tiup os=linux, arch=amd64 - Getting system info of 10.0.128.24:22 ... ⠴ CopyComponent: component=insight, version=, remote=10.0.128.24:/tmp/tiup os=linux, arch=amd64 - Getting system info of 10.0.138.132:22 ... ⠴ CopyComponent: component=insight, version=, remote=10.0.138.132:/tmp/tiup os=linux, arch=amd64 + Collect basic system information - Getting system info of 10.0.131.156:22 ... Done + Collect basic system information - Getting system info of 10.0.131.156:22 ... Done - Getting system info of 10.0.138.103:22 ... Done - Getting system info of 10.0.128.24:22 ... Done - Getting system info of 10.0.138.132:22 ... Done - Getting system info of 10.0.137.245:22 ... Done - Getting system info of 10.0.141.19:22 ... Done - Getting system info of 10.0.134.85:22 ... Done + Check system requirements - Checking node 10.0.131.156 ... ⠏ CheckSys: host=10.0.131.156 type=exist - Checking node 10.0.138.103 ... ⠏ CheckSys: host=10.0.138.103 type=exist - Checking node 10.0.128.24 ... ⠏ CheckSys: host=10.0.128.24 type=exist - Checking node 10.0.138.132 ... ⠏ CheckSys: host=10.0.138.132 type=exist + Check system requirements - Checking node 10.0.131.156 ... ⠙ Shell: host=10.0.131.156, sudo=false, command=`cat /etc/security/limits.conf` - Checking node 10.0.138.103 ... ⠙ Shell: host=10.0.138.103, sudo=false, command=`cat /etc/security/limits.conf` + Check system requirements - Checking node 10.0.131.156 ... ⠹ Shell: host=10.0.131.156, sudo=false, command=`cat /etc/security/limits.conf` + Check system requirements - Checking node 10.0.131.156 ... ⠹ CheckSys: host=10.0.131.156 type=package - Checking node 10.0.138.103 ... ⠹ CheckSys: host=10.0.138.103 type=package - Checking node 10.0.128.24 ... ⠹ CheckSys: host=10.0.128.24 type=package - Checking node 10.0.138.132 ... ⠹ CheckSys: host=10.0.138.132 type=package + Check system requirements + Check system requirements - Checking node 10.0.131.156 ... Done + Check system requirements + Check system requirements + Check system requirements + Check system requirements - Checking node 10.0.131.156 ... Done - Checking node 10.0.138.103 ... Done - Checking node 10.0.128.24 ... Done - Checking node 10.0.138.132 ... Done - Checking node 10.0.137.245 ... Done - Checking node 10.0.141.19 ... Done - Checking node 10.0.134.85 ... Done - Checking node 10.0.141.19 ... Done - Checking node 10.0.131.156 ... Done - Checking node 10.0.138.103 ... Done - Checking node 10.0.128.24 ... Done - Checking node 10.0.131.156 ... Done - Checking node 10.0.138.103 ... Done - Checking node 10.0.128.24 ... Done + Cleanup check files - Cleanup check files on 10.0.131.156:22 ... Done - Cleanup check files on 10.0.138.103:22 ... Done - Cleanup check files on 10.0.128.24:22 ... Done - Cleanup check files on 10.0.138.132:22 ... Done - Cleanup check files on 10.0.137.245:22 ... Done - Cleanup check files on 10.0.141.19:22 ... Done - Cleanup check files on 10.0.134.85:22 ... Done - Cleanup check files on 10.0.141.19:22 ... Done - Cleanup check files on 10.0.131.156:22 ... Done - Cleanup check files on 10.0.138.103:22 ... Done - Cleanup check files on 10.0.128.24:22 ... Done - Cleanup check files on 10.0.131.156:22 ... Done - Cleanup check files on 10.0.138.103:22 ... Done - Cleanup check files on 10.0.128.24:22 ... Done Node Check Result Message ---- ----- ------ ------- 10.0.138.103 service Pass service firewalld not found, ignore 10.0.138.103 command Pass numactl: policy: default 10.0.138.103 os-version Pass OS is Amazon Linux 2 10.0.138.103 cpu-cores Pass number of CPU cores / threads: 8 10.0.138.103 cpu-governor Warn Unable to determine current CPU frequency governor policy 10.0.138.103 memory Pass memory size is 32768MB 10.0.138.103 selinux Pass SELinux is disabled 10.0.138.103 thp Pass THP is disabled 10.0.128.24 command Pass numactl: policy: default 10.0.128.24 os-version Pass OS is Amazon Linux 2 10.0.128.24 cpu-cores Pass number of CPU cores / threads: 8 10.0.128.24 cpu-governor Warn Unable to determine current CPU frequency governor policy 10.0.128.24 memory Pass memory size is 32768MB 10.0.128.24 selinux Pass SELinux is disabled 10.0.128.24 thp Pass THP is disabled 10.0.128.24 service Pass service firewalld not found, ignore 10.0.138.132 command Pass numactl: policy: default 10.0.138.132 os-version Pass OS is Amazon Linux 2 10.0.138.132 cpu-cores Pass number of CPU cores / threads: 8 10.0.138.132 cpu-governor Warn Unable to determine current CPU frequency governor policy 10.0.138.132 memory Pass memory size is 32768MB 10.0.138.132 selinux Pass SELinux is disabled 10.0.138.132 thp Pass THP is disabled 10.0.138.132 service Pass service firewalld not found, ignore 10.0.137.245 service Pass service firewalld not found, ignore 10.0.137.245 command Pass numactl: policy: default 10.0.137.245 os-version Pass OS is Amazon Linux 2 10.0.137.245 cpu-cores Pass number of CPU cores / threads: 8 10.0.137.245 cpu-governor Warn Unable to determine current CPU frequency governor policy 10.0.137.245 memory Pass memory size is 32768MB 10.0.137.245 selinux Pass SELinux is disabled 10.0.137.245 thp Pass THP is disabled 10.0.141.19 thp Pass THP is disabled 10.0.141.19 service Pass service firewalld not found, ignore 10.0.141.19 command Pass numactl: policy: default 10.0.141.19 os-version Pass OS is Amazon Linux 2 10.0.141.19 cpu-cores Pass number of CPU cores / threads: 8 10.0.141.19 cpu-governor Warn Unable to determine current CPU frequency governor policy 10.0.141.19 memory Pass memory size is 32768MB 10.0.141.19 selinux Pass SELinux is disabled 10.0.134.85 selinux Pass SELinux is disabled 10.0.134.85 thp Pass THP is disabled 10.0.134.85 service Pass service firewalld not found, ignore 10.0.134.85 command Pass numactl: policy: default 10.0.134.85 os-version Pass OS is Amazon Linux 2 10.0.134.85 cpu-cores Pass number of CPU cores / threads: 8 10.0.134.85 cpu-governor Warn Unable to determine current CPU frequency governor policy 10.0.134.85 memory Pass memory size is 32768MB 10.0.131.156 thp Pass THP is disabled 10.0.131.156 service Pass service firewalld not found, ignore 10.0.131.156 command Pass numactl: policy: default 10.0.131.156 os-version Pass OS is Amazon Linux 2 10.0.131.156 cpu-cores Pass number of CPU cores / threads: 8 10.0.131.156 cpu-governor Warn Unable to determine current CPU frequency governor policy 10.0.131.156 memory Pass memory size is 32768MB 10.0.131.156 selinux Pass SELinux is disabled $

What did you see instead?

[ec2-user@ip-10-0-5-38 tiup_config]$ tiup cluster check ./topology.yaml -i ~/.ssh/keys/yahondatest.pem tiup is checking updates for component cluster ... A new version of cluster is available: The latest version: v1.10.0 Local installed version: Update current component: tiup update cluster Update all components: tiup update --all The component `cluster` version is not installed; downloading from repository. download https://tiup-mirrors.pingcap.com/cluster-v1.10.0-linux-amd64.tar.gz 8.28 MiB / 8.28 MiB 100.00% ? MiB/s Starting component `cluster`: /home/ec2-user/.tiup/components/cluster/v1.10.0/tiup-cluster check ./topology.yaml -i /home/ec2-user/.ssh/keys/yahondatest.pem + Detect CPU Arch Name - Detecting node 10.0.131.156 Arch info ... Error - Detecting node 10.0.138.103 Arch info ... Error - Detecting node 10.0.128.24 Arch info ... Error - Detecting node 10.0.138.132 Arch info ... Error - Detecting node 10.0.137.245 Arch info ... Error - Detecting node 10.0.141.19 Arch info ... Error - Detecting node 10.0.134.85 Arch info ... Error Error: failed to fetch cpu-arch or kernel-name: executor.ssh.execute_failed: Failed to execute command over SSH for 'ec2-user@10.0.131.156:22' {ssh_stderr: , ssh_stdout: , ssh_command: export LANG=C; PATH=$PATH:/bin:/sbin:/usr/bin:/usr/sbin uname -m}, cause: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none], no supported methods remain Verbose debug logs has been written to /home/ec2-user/.tiup/logs/tiup-cluster-debug-2022-06-09-01-54-02.log.

What version of TiUP are you using (tiup --version)?

$ tiup --version
1.10.0 tiup
Go Version: go1.18.2
Git Ref: v1.10.0
GitHash: 16c5f6b2822599336e18e5023bb8d2d77509745c

[ec2-user@ip-10-0-5-38 tiup_config]$ tiup cluster:v1.9.6 check ./topology.yaml -i ~/.ssh/keys/yahondatest.pem The component `cluster` version v1.9.6 is not installed; downloading from repository. download https://tiup-mirrors.pingcap.com/cluster-v1.9.6-linux-amd64.tar.gz 7.82 MiB / 7.82 MiB 100.00% ? MiB/s Starting component `cluster`: /home/ec2-user/.tiup/components/cluster/v1.9.6/tiup-cluster check ./topology.yaml -i /home/ec2-user/.ssh/keys/yahondatest.pem + Detect CPU Arch - Detecting node 10.0.131.156 ... ⠙ Shell: host=10.0.131.156, sudo=false, command=`uname -m` + Detect CPU Arch - Detecting node 10.0.131.156 ... Done - Detecting node 10.0.138.103 ... Done - Detecting node 10.0.128.24 ... Done - Detecting node 10.0.138.132 ... Done - Detecting node 10.0.137.245 ... Done - Detecting node 10.0.141.19 ... Done - Detecting node 10.0.134.85 ... Done + Download necessary tools - Downloading check tools for linux/amd64 ... Done + Collect basic system information - Getting system info of 10.0.131.156:22 ... ⠴ CopyComponent: component=insight, version=, remote=10.0.131.156:/tmp/tiup os=linux, arch=amd64 - Getting system info of 10.0.138.103:22 ... ⠴ CopyComponent: component=insight, version=, remote=10.0.138.103:/tmp/tiup os=linux, arch=amd64 - Getting system info of 10.0.128.24:22 ... ⠴ CopyComponent: component=insight, version=, remote=10.0.128.24:/tmp/tiup os=linux, arch=amd64 - Getting system info of 10.0.138.132:22 ... ⠴ CopyComponent: component=insight, version=, remote=10.0.138.132:/tmp/tiup os=linux, arch=amd64 + Collect basic system information - Getting system info of 10.0.131.156:22 ... Done + Collect basic system information - Getting system info of 10.0.131.156:22 ... Done - Getting system info of 10.0.138.103:22 ... Done - Getting system info of 10.0.128.24:22 ... Done - Getting system info of 10.0.138.132:22 ... Done - Getting system info of 10.0.137.245:22 ... Done - Getting system info of 10.0.141.19:22 ... Done - Getting system info of 10.0.134.85:22 ... Done + Check system requirements - Checking node 10.0.131.156 ... ⠏ CheckSys: host=10.0.131.156 type=exist - Checking node 10.0.138.103 ... ⠏ CheckSys: host=10.0.138.103 type=exist - Checking node 10.0.128.24 ... ⠏ CheckSys: host=10.0.128.24 type=exist - Checking node 10.0.138.132 ... ⠏ CheckSys: host=10.0.138.132 type=exist + Check system requirements - Checking node 10.0.131.156 ... ⠙ Shell: host=10.0.131.156, sudo=false, command=`cat /etc/security/limits.conf` - Checking node 10.0.138.103 ... ⠙ Shell: host=10.0.138.103, sudo=false, command=`cat /etc/security/limits.conf` - Checking node 10.0.128.24 ... ⠙ Shell: host=10.0.128.24, sudo=false, command=`cat /etc/security/limits.conf` + Check system requirements + Check system requirements - Checking node 10.0.131.156 ... ⠹ CheckSys: host=10.0.131.156 type=package - Checking node 10.0.138.103 ... ⠹ CheckSys: host=10.0.138.103 type=package - Checking node 10.0.128.24 ... ⠹ CheckSys: host=10.0.128.24 type=package + Check system requirements + Check system requirements + Check system requirements - Checking node 10.0.131.156 ... Done + Check system requirements + Check system requirements + Check system requirements + Check system requirements - Checking node 10.0.131.156 ... Done - Checking node 10.0.138.103 ... Done - Checking node 10.0.128.24 ... Done - Checking node 10.0.138.132 ... Done - Checking node 10.0.137.245 ... Done - Checking node 10.0.141.19 ... Done - Checking node 10.0.134.85 ... Done - Checking node 10.0.141.19 ... Done - Checking node 10.0.131.156 ... Done - Checking node 10.0.138.103 ... Done - Checking node 10.0.128.24 ... Done - Checking node 10.0.131.156 ... Done - Checking node 10.0.138.103 ... Done - Checking node 10.0.128.24 ... Done + Cleanup check files - Cleanup check files on 10.0.131.156:22 ... Done - Cleanup check files on 10.0.138.103:22 ... Done - Cleanup check files on 10.0.128.24:22 ... Done - Cleanup check files on 10.0.138.132:22 ... Done - Cleanup check files on 10.0.137.245:22 ... Done - Cleanup check files on 10.0.141.19:22 ... Done - Cleanup check files on 10.0.134.85:22 ... Done - Cleanup check files on 10.0.141.19:22 ... Done - Cleanup check files on 10.0.131.156:22 ... Done - Cleanup check files on 10.0.138.103:22 ... Done - Cleanup check files on 10.0.128.24:22 ... Done - Cleanup check files on 10.0.131.156:22 ... Done - Cleanup check files on 10.0.138.103:22 ... Done - Cleanup check files on 10.0.128.24:22 ... Done Node Check Result Message ---- ----- ------ ------- 10.0.131.156 os-version Pass OS is Amazon Linux 2 10.0.131.156 cpu-cores Pass number of CPU cores / threads: 8 10.0.131.156 cpu-governor Warn Unable to determine current CPU frequency governor policy 10.0.131.156 memory Pass memory size is 32768MB 10.0.131.156 selinux Pass SELinux is disabled 10.0.131.156 thp Pass THP is disabled 10.0.131.156 service Pass service firewalld not found, ignore 10.0.131.156 command Pass numactl: policy: default 10.0.138.103 cpu-cores Pass number of CPU cores / threads: 8 10.0.138.103 cpu-governor Warn Unable to determine current CPU frequency governor policy 10.0.138.103 memory Pass memory size is 32768MB 10.0.138.103 selinux Pass SELinux is disabled 10.0.138.103 thp Pass THP is disabled 10.0.138.103 service Pass service firewalld not found, ignore 10.0.138.103 command Pass numactl: policy: default 10.0.138.103 os-version Pass OS is Amazon Linux 2 10.0.128.24 selinux Pass SELinux is disabled 10.0.128.24 thp Pass THP is disabled 10.0.128.24 service Pass service firewalld not found, ignore 10.0.128.24 command Pass numactl: policy: default 10.0.128.24 os-version Pass OS is Amazon Linux 2 10.0.128.24 cpu-cores Pass number of CPU cores / threads: 8 10.0.128.24 cpu-governor Warn Unable to determine current CPU frequency governor policy 10.0.128.24 memory Pass memory size is 32768MB 10.0.138.132 memory Pass memory size is 32768MB 10.0.138.132 selinux Pass SELinux is disabled 10.0.138.132 thp Pass THP is disabled 10.0.138.132 service Pass service firewalld not found, ignore 10.0.138.132 command Pass numactl: policy: default 10.0.138.132 os-version Pass OS is Amazon Linux 2 10.0.138.132 cpu-cores Pass number of CPU cores / threads: 8 10.0.138.132 cpu-governor Warn Unable to determine current CPU frequency governor policy 10.0.137.245 service Pass service firewalld not found, ignore 10.0.137.245 command Pass numactl: policy: default 10.0.137.245 os-version Pass OS is Amazon Linux 2 10.0.137.245 cpu-cores Pass number of CPU cores / threads: 8 10.0.137.245 cpu-governor Warn Unable to determine current CPU frequency governor policy 10.0.137.245 memory Pass memory size is 32768MB 10.0.137.245 selinux Pass SELinux is disabled 10.0.137.245 thp Pass THP is disabled 10.0.141.19 os-version Pass OS is Amazon Linux 2 10.0.141.19 cpu-cores Pass number of CPU cores / threads: 8 10.0.141.19 cpu-governor Warn Unable to determine current CPU frequency governor policy 10.0.141.19 memory Pass memory size is 32768MB 10.0.141.19 selinux Pass SELinux is disabled 10.0.141.19 thp Pass THP is disabled 10.0.141.19 service Pass service firewalld not found, ignore 10.0.141.19 command Pass numactl: policy: default 10.0.134.85 os-version Pass OS is Amazon Linux 2 10.0.134.85 cpu-cores Pass number of CPU cores / threads: 8 10.0.134.85 cpu-governor Warn Unable to determine current CPU frequency governor policy 10.0.134.85 memory Pass memory size is 32768MB 10.0.134.85 selinux Pass SELinux is disabled 10.0.134.85 thp Pass THP is disabled 10.0.134.85 service Pass service firewalld not found, ignore 10.0.134.85 command Pass numactl: policy: default $

Just grepped ERROR from tiup-cluster-debug-2022-06-09-01-54-02.log

2022-06-09T01:54:02.449Z    ERROR   SSHCommand  {"host": "10.0.131.156", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/bin:/sbin:/usr/bin:/usr/sbin uname -m", "error": "ssh: handshake failed: ssh: unable to authenticate, attempted methods [none], no supported methods remain", "stdout": "", "stderr": ""}
2022-06-09T01:54:02.449Z    ERROR   CheckPoint  {"host": "10.0.131.156", "port": 22, "user": "ec2-user", "sudo": false, "cmd": "uname -m", "stdout": "", "stderr": "", "error": "executor.ssh.execute_failed: Failed to execute command over SSH for 'ec2-user@10.0.131.156:22' {ssh_stderr: , ssh_stdout: , ssh_command: export LANG=C; PATH=$PATH:/bin:/sbin:/usr/bin:/usr/sbin uname -m}, cause: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none], no supported methods remain", "errorVerbose": "executor.ssh.execute_failed: Failed to execute command over SSH for 'ec2-user@10.0.131.156:22' {ssh_stderr: , ssh_stdout: , ssh_command: export LANG=C; PATH=$PATH:/bin:/sbin:/usr/bin:/usr/sbin uname -m}, cause: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none], no supported methods remain\n at github.com/pingcap/tiup/pkg/cluster/executor.(*EasySSHExecutor).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/executor/ssh.go:174\n at github.com/pingcap/tiup/pkg/cluster/executor.(*CheckPointExecutor).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/executor/checkpoint.go:85\n at github.com/pingcap/tiup/pkg/cluster/task.(*Shell).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/shell.go:43\n at github.com/pingcap/tiup/pkg/cluster/task.(*Serial).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/task.go:86\n at github.com/pingcap/tiup/pkg/cluster/task.(*StepDisplay).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/step.go:111\n at github.com/pingcap/tiup/pkg/cluster/task.(*Parallel).Execute.func1()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/task.go:144\n at runtime.goexit()\n\truntime/asm_amd64.s:1571", "__hash__": "16c5f6b2822599336e18e5023bb8d2d77509745c", "__func__": "github.com/pingcap/tiup/pkg/cluster/executor.(*CheckPointExecutor).Execute", "hit": false}
2022-06-09T01:54:02.449Z    ERROR   SSHCommand  {"host": "10.0.137.245", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/bin:/sbin:/usr/bin:/usr/sbin uname -m", "error": "ssh: handshake failed: ssh: unable to authenticate, attempted methods [none], no supported methods remain", "stdout": "", "stderr": ""}
2022-06-09T01:54:02.450Z    ERROR   SSHCommand  {"host": "10.0.138.132", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/bin:/sbin:/usr/bin:/usr/sbin uname -m", "error": "ssh: handshake failed: ssh: unable to authenticate, attempted methods [none], no supported methods remain", "stdout": "", "stderr": ""}
2022-06-09T01:54:02.449Z    ERROR   CheckPoint  {"host": "10.0.137.245", "port": 22, "user": "ec2-user", "sudo": false, "cmd": "uname -m", "stdout": "", "stderr": "", "error": "executor.ssh.execute_failed: Failed to execute command over SSH for 'ec2-user@10.0.137.245:22' {ssh_stderr: , ssh_stdout: , ssh_command: export LANG=C; PATH=$PATH:/bin:/sbin:/usr/bin:/usr/sbin uname -m}, cause: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none], no supported methods remain", "errorVerbose": "executor.ssh.execute_failed: Failed to execute command over SSH for 'ec2-user@10.0.137.245:22' {ssh_stderr: , ssh_stdout: , ssh_command: export LANG=C; PATH=$PATH:/bin:/sbin:/usr/bin:/usr/sbin uname -m}, cause: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none], no supported methods remain\n at github.com/pingcap/tiup/pkg/cluster/executor.(*EasySSHExecutor).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/executor/ssh.go:174\n at github.com/pingcap/tiup/pkg/cluster/executor.(*CheckPointExecutor).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/executor/checkpoint.go:85\n at github.com/pingcap/tiup/pkg/cluster/task.(*Shell).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/shell.go:43\n at github.com/pingcap/tiup/pkg/cluster/task.(*Serial).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/task.go:86\n at github.com/pingcap/tiup/pkg/cluster/task.(*StepDisplay).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/step.go:111\n at github.com/pingcap/tiup/pkg/cluster/task.(*Parallel).Execute.func1()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/task.go:144\n at runtime.goexit()\n\truntime/asm_amd64.s:1571", "__hash__": "16c5f6b2822599336e18e5023bb8d2d77509745c", "__func__": "github.com/pingcap/tiup/pkg/cluster/executor.(*CheckPointExecutor).Execute", "hit": false}
2022-06-09T01:54:02.450Z    ERROR   CheckPoint  {"host": "10.0.138.132", "port": 22, "user": "ec2-user", "sudo": false, "cmd": "uname -m", "stdout": "", "stderr": "", "error": "executor.ssh.execute_failed: Failed to execute command over SSH for 'ec2-user@10.0.138.132:22' {ssh_stderr: , ssh_stdout: , ssh_command: export LANG=C; PATH=$PATH:/bin:/sbin:/usr/bin:/usr/sbin uname -m}, cause: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none], no supported methods remain", "errorVerbose": "executor.ssh.execute_failed: Failed to execute command over SSH for 'ec2-user@10.0.138.132:22' {ssh_stderr: , ssh_stdout: , ssh_command: export LANG=C; PATH=$PATH:/bin:/sbin:/usr/bin:/usr/sbin uname -m}, cause: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none], no supported methods remain\n at github.com/pingcap/tiup/pkg/cluster/executor.(*EasySSHExecutor).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/executor/ssh.go:174\n at github.com/pingcap/tiup/pkg/cluster/executor.(*CheckPointExecutor).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/executor/checkpoint.go:85\n at github.com/pingcap/tiup/pkg/cluster/task.(*Shell).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/shell.go:43\n at github.com/pingcap/tiup/pkg/cluster/task.(*Serial).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/task.go:86\n at github.com/pingcap/tiup/pkg/cluster/task.(*StepDisplay).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/step.go:111\n at github.com/pingcap/tiup/pkg/cluster/task.(*Parallel).Execute.func1()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/task.go:144\n at runtime.goexit()\n\truntime/asm_amd64.s:1571", "__hash__": "16c5f6b2822599336e18e5023bb8d2d77509745c", "__func__": "github.com/pingcap/tiup/pkg/cluster/executor.(*CheckPointExecutor).Execute", "hit": false}
2022-06-09T01:54:02.450Z    ERROR   SSHCommand  {"host": "10.0.138.103", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/bin:/sbin:/usr/bin:/usr/sbin uname -m", "error": "ssh: handshake failed: ssh: unable to authenticate, attempted methods [none], no supported methods remain", "stdout": "", "stderr": ""}
2022-06-09T01:54:02.450Z    ERROR   CheckPoint  {"host": "10.0.138.103", "port": 22, "user": "ec2-user", "sudo": false, "cmd": "uname -m", "stdout": "", "stderr": "", "error": "executor.ssh.execute_failed: Failed to execute command over SSH for 'ec2-user@10.0.138.103:22' {ssh_stderr: , ssh_stdout: , ssh_command: export LANG=C; PATH=$PATH:/bin:/sbin:/usr/bin:/usr/sbin uname -m}, cause: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none], no supported methods remain", "errorVerbose": "executor.ssh.execute_failed: Failed to execute command over SSH for 'ec2-user@10.0.138.103:22' {ssh_stderr: , ssh_stdout: , ssh_command: export LANG=C; PATH=$PATH:/bin:/sbin:/usr/bin:/usr/sbin uname -m}, cause: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none], no supported methods remain\n at github.com/pingcap/tiup/pkg/cluster/executor.(*EasySSHExecutor).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/executor/ssh.go:174\n at github.com/pingcap/tiup/pkg/cluster/executor.(*CheckPointExecutor).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/executor/checkpoint.go:85\n at github.com/pingcap/tiup/pkg/cluster/task.(*Shell).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/shell.go:43\n at github.com/pingcap/tiup/pkg/cluster/task.(*Serial).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/task.go:86\n at github.com/pingcap/tiup/pkg/cluster/task.(*StepDisplay).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/step.go:111\n at github.com/pingcap/tiup/pkg/cluster/task.(*Parallel).Execute.func1()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/task.go:144\n at runtime.goexit()\n\truntime/asm_amd64.s:1571", "__hash__": "16c5f6b2822599336e18e5023bb8d2d77509745c", "__func__": "github.com/pingcap/tiup/pkg/cluster/executor.(*CheckPointExecutor).Execute", "hit": false}
2022-06-09T01:54:02.450Z    ERROR   SSHCommand  {"host": "10.0.128.24", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/bin:/sbin:/usr/bin:/usr/sbin uname -m", "error": "ssh: handshake failed: ssh: unable to authenticate, attempted methods [none], no supported methods remain", "stdout": "", "stderr": ""}
2022-06-09T01:54:02.450Z    ERROR   CheckPoint  {"host": "10.0.128.24", "port": 22, "user": "ec2-user", "sudo": false, "cmd": "uname -m", "stdout": "", "stderr": "", "error": "executor.ssh.execute_failed: Failed to execute command over SSH for 'ec2-user@10.0.128.24:22' {ssh_stderr: , ssh_stdout: , ssh_command: export LANG=C; PATH=$PATH:/bin:/sbin:/usr/bin:/usr/sbin uname -m}, cause: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none], no supported methods remain", "errorVerbose": "executor.ssh.execute_failed: Failed to execute command over SSH for 'ec2-user@10.0.128.24:22' {ssh_stderr: , ssh_stdout: , ssh_command: export LANG=C; PATH=$PATH:/bin:/sbin:/usr/bin:/usr/sbin uname -m}, cause: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none], no supported methods remain\n at github.com/pingcap/tiup/pkg/cluster/executor.(*EasySSHExecutor).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/executor/ssh.go:174\n at github.com/pingcap/tiup/pkg/cluster/executor.(*CheckPointExecutor).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/executor/checkpoint.go:85\n at github.com/pingcap/tiup/pkg/cluster/task.(*Shell).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/shell.go:43\n at github.com/pingcap/tiup/pkg/cluster/task.(*Serial).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/task.go:86\n at github.com/pingcap/tiup/pkg/cluster/task.(*StepDisplay).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/step.go:111\n at github.com/pingcap/tiup/pkg/cluster/task.(*Parallel).Execute.func1()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/task.go:144\n at runtime.goexit()\n\truntime/asm_amd64.s:1571", "__hash__": "16c5f6b2822599336e18e5023bb8d2d77509745c", "__func__": "github.com/pingcap/tiup/pkg/cluster/executor.(*CheckPointExecutor).Execute", "hit": false}
2022-06-09T01:54:02.464Z    ERROR   SSHCommand  {"host": "10.0.134.85", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/bin:/sbin:/usr/bin:/usr/sbin uname -m", "error": "ssh: handshake failed: ssh: unable to authenticate, attempted methods [none], no supported methods remain", "stdout": "", "stderr": ""}
2022-06-09T01:54:02.464Z    ERROR   CheckPoint  {"host": "10.0.134.85", "port": 22, "user": "ec2-user", "sudo": false, "cmd": "uname -m", "stdout": "", "stderr": "", "error": "executor.ssh.execute_failed: Failed to execute command over SSH for 'ec2-user@10.0.134.85:22' {ssh_stderr: , ssh_stdout: , ssh_command: export LANG=C; PATH=$PATH:/bin:/sbin:/usr/bin:/usr/sbin uname -m}, cause: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none], no supported methods remain", "errorVerbose": "executor.ssh.execute_failed: Failed to execute command over SSH for 'ec2-user@10.0.134.85:22' {ssh_stderr: , ssh_stdout: , ssh_command: export LANG=C; PATH=$PATH:/bin:/sbin:/usr/bin:/usr/sbin uname -m}, cause: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none], no supported methods remain\n at github.com/pingcap/tiup/pkg/cluster/executor.(*EasySSHExecutor).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/executor/ssh.go:174\n at github.com/pingcap/tiup/pkg/cluster/executor.(*CheckPointExecutor).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/executor/checkpoint.go:85\n at github.com/pingcap/tiup/pkg/cluster/task.(*Shell).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/shell.go:43\n at github.com/pingcap/tiup/pkg/cluster/task.(*Serial).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/task.go:86\n at github.com/pingcap/tiup/pkg/cluster/task.(*StepDisplay).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/step.go:111\n at github.com/pingcap/tiup/pkg/cluster/task.(*Parallel).Execute.func1()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/task.go:144\n at runtime.goexit()\n\truntime/asm_amd64.s:1571", "__hash__": "16c5f6b2822599336e18e5023bb8d2d77509745c", "__func__": "github.com/pingcap/tiup/pkg/cluster/executor.(*CheckPointExecutor).Execute", "hit": false}
2022-06-09T01:54:02.465Z    ERROR   SSHCommand  {"host": "10.0.141.19", "port": "22", "cmd": "export LANG=C; PATH=$PATH:/bin:/sbin:/usr/bin:/usr/sbin uname -m", "error": "ssh: handshake failed: ssh: unable to authenticate, attempted methods [none], no supported methods remain", "stdout": "", "stderr": ""}
2022-06-09T01:54:02.465Z    ERROR   CheckPoint  {"host": "10.0.141.19", "port": 22, "user": "ec2-user", "sudo": false, "cmd": "uname -m", "stdout": "", "stderr": "", "error": "executor.ssh.execute_failed: Failed to execute command over SSH for 'ec2-user@10.0.141.19:22' {ssh_stderr: , ssh_stdout: , ssh_command: export LANG=C; PATH=$PATH:/bin:/sbin:/usr/bin:/usr/sbin uname -m}, cause: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none], no supported methods remain", "errorVerbose": "executor.ssh.execute_failed: Failed to execute command over SSH for 'ec2-user@10.0.141.19:22' {ssh_stderr: , ssh_stdout: , ssh_command: export LANG=C; PATH=$PATH:/bin:/sbin:/usr/bin:/usr/sbin uname -m}, cause: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none], no supported methods remain\n at github.com/pingcap/tiup/pkg/cluster/executor.(*EasySSHExecutor).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/executor/ssh.go:174\n at github.com/pingcap/tiup/pkg/cluster/executor.(*CheckPointExecutor).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/executor/checkpoint.go:85\n at github.com/pingcap/tiup/pkg/cluster/task.(*Shell).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/shell.go:43\n at github.com/pingcap/tiup/pkg/cluster/task.(*Serial).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/task.go:86\n at github.com/pingcap/tiup/pkg/cluster/task.(*StepDisplay).Execute()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/step.go:111\n at github.com/pingcap/tiup/pkg/cluster/task.(*Parallel).Execute.func1()\n\tgithub.com/pingcap/tiup/pkg/cluster/task/task.go:144\n at runtime.goexit()\n\truntime/asm_amd64.s:1571", "__hash__": "16c5f6b2822599336e18e5023bb8d2d77509745c", "__func__": "github.com/pingcap/tiup/pkg/cluster/executor.(*CheckPointExecutor).Execute", "hit": false}

[ec2-user@ip-10-0-5-38 ~]$ tiup update --self download https://tiup-mirrors.pingcap.com/tiup-v1.10.1-linux-amd64.tar.gz 6.80 MiB / 6.80 MiB 100.00% 529.77 MiB/s Updated successfully! [ec2-user@ip-10-0-5-38 ~]$ tiup -v 1.10.1 tiup Go Version: go1.18.2 [ec2-user@ip-10-0-5-38 tiup_config]$ tiup update --all download https://tiup-mirrors.pingcap.com/cluster-v1.10.1-linux-amd64.tar.gz 8.28 MiB / 8.28 MiB 100.00% ? MiB/s component grafana version v6.0.0 is already installed component pd version v6.0.0 is already installed download https://tiup-mirrors.pingcap.com/playground-v1.10.1-linux-amd64.tar.gz 7.31 MiB / 7.31 MiB 100.00% ? MiB/s component prometheus version v6.0.0 is already installed component tidb version v6.0.0 is already installed component tiflash version v6.0.0 is already installed component tikv version v6.0.0 is already installed Updated successfully! [ec2-user@ip-10-0-5-38 tiup_config]$ tiup cluster check ./topology.yaml -i ~/.ssh/keys/yahondatest.pem tiup is checking updates for component cluster ... Starting component `cluster`: /home/ec2-user/.tiup/components/cluster/v1.10.1/tiup-cluster check ./topology.yaml -i /home/ec2-user/.ssh/keys/yahondatest.pem + Detect CPU Arch Name - Detecting node 10.0.131.156 Arch info ... ⠙ Shell: host=10.0.131.156, sudo=false, command=`uname -m` + Detect CPU Arch Name - Detecting node 10.0.131.156 Arch info ... Done - Detecting node 10.0.138.103 Arch info ... Done - Detecting node 10.0.128.24 Arch info ... Done - Detecting node 10.0.138.132 Arch info ... Done - Detecting node 10.0.137.245 Arch info ... Done - Detecting node 10.0.141.19 Arch info ... Done - Detecting node 10.0.134.85 Arch info ... Done + Detect CPU OS Name - Detecting node 10.0.131.156 OS info ... ⠙ Shell: host=10.0.131.156, sudo=false, command=`uname -s` + Detect CPU OS Name - Detecting node 10.0.131.156 OS info ... Done - Detecting node 10.0.138.103 OS info ... Done - Detecting node 10.0.128.24 OS info ... Done - Detecting node 10.0.138.132 OS info ... Done - Detecting node 10.0.137.245 OS info ... Done - Detecting node 10.0.141.19 OS info ... Done - Detecting node 10.0.134.85 OS info ... Done + Download necessary tools - Downloading check tools for linux/amd64 ... Done + Collect basic system information - Getting system info of 10.0.131.156:22 ... ⠼ CopyComponent: component=insight, version=, remote=10.0.131.156:/tmp/tiu... - Getting system info of 10.0.138.103:22 ... ⠼ CopyComponent: component=insight, version=, remote=10.0.138.103:/tmp/tiu... - Getting system info of 10.0.128.24:22 ... ⠼ CopyComponent: component=insight, version=, remote=10.0.128.24:/tmp/tiup ... + Collect basic system information + Collect basic system information - Getting system info of 10.0.131.156:22 ... Done + Collect basic system information - Getting system info of 10.0.131.156:22 ... Done - Getting system info of 10.0.138.103:22 ... Done - Getting system info of 10.0.128.24:22 ... Done - Getting system info of 10.0.138.132:22 ... Done - Getting system info of 10.0.137.245:22 ... Done - Getting system info of 10.0.141.19:22 ... Done - Getting system info of 10.0.134.85:22 ... Done + Check system requirements - Checking node 10.0.131.156 ... ⠏ CheckSys: host=10.0.131.156 type=exist - Checking node 10.0.138.103 ... ⠏ CheckSys: host=10.0.138.103 type=exist - Checking node 10.0.128.24 ... ⠏ CheckSys: host=10.0.128.24 type=exist - Checking node 10.0.138.132 ... ⠏ CheckSys: host=10.0.138.132 type=exist + Check system requirements - Checking node 10.0.131.156 ... ⠙ Shell: host=10.0.131.156, sudo=false, command=`cat /etc/security/limits.conf` + Check system requirements - Checking node 10.0.131.156 ... ⠹ Shell: host=10.0.131.156, sudo=false, command=`cat /etc/security/limits.conf` - Checking node 10.0.138.103 ... ⠹ Shell: host=10.0.138.103, sudo=false, command=`cat /etc/security/limits.conf` + Check system requirements - Checking node 10.0.131.156 ... ⠹ CheckSys: host=10.0.131.156 type=package - Checking node 10.0.138.103 ... ⠹ CheckSys: host=10.0.138.103 type=package - Checking node 10.0.128.24 ... ⠹ CheckSys: host=10.0.128.24 type=package + Check system requirements + Check system requirements + Check system requirements - Checking node 10.0.131.156 ... Done + Check system requirements + Check system requirements + Check system requirements + Check system requirements - Checking node 10.0.131.156 ... Done - Checking node 10.0.138.103 ... Done - Checking node 10.0.128.24 ... Done - Checking node 10.0.138.132 ... Done - Checking node 10.0.137.245 ... Done - Checking node 10.0.141.19 ... Done - Checking node 10.0.134.85 ... Done - Checking node 10.0.141.19 ... Done - Checking node 10.0.131.156 ... Done - Checking node 10.0.138.103 ... Done - Checking node 10.0.128.24 ... Done - Checking node 10.0.131.156 ... Done - Checking node 10.0.138.103 ... Done - Checking node 10.0.128.24 ... Done + Cleanup check files - Cleanup check files on 10.0.131.156:22 ... Done - Cleanup check files on 10.0.138.103:22 ... Done - Cleanup check files on 10.0.128.24:22 ... Done - Cleanup check files on 10.0.138.132:22 ... Done - Cleanup check files on 10.0.137.245:22 ... Done - Cleanup check files on 10.0.141.19:22 ... Done - Cleanup check files on 10.0.134.85:22 ... Done - Cleanup check files on 10.0.141.19:22 ... Done - Cleanup check files on 10.0.131.156:22 ... Done - Cleanup check files on 10.0.138.103:22 ... Done - Cleanup check files on 10.0.128.24:22 ... Done - Cleanup check files on 10.0.131.156:22 ... Done - Cleanup check files on 10.0.138.103:22 ... Done - Cleanup check files on 10.0.128.24:22 ... Done Node Check Result Message ---- ----- ------ ------- 10.0.138.132 selinux Pass SELinux is disabled 10.0.138.132 service Pass service firewalld not found, ignore 10.0.138.132 command Pass numactl: policy: default 10.0.138.132 os-version Pass OS is Amazon Linux 2 10.0.138.132 cpu-governor Warn Unable to determine current CPU frequency governor policy 10.0.138.132 timezone Pass time zone is the same as the first PD machine: UTC 10.0.138.132 cpu-cores Pass number of CPU cores / threads: 8 10.0.138.132 memory Pass memory size is 32768MB 10.0.138.132 thp Pass THP is disabled 10.0.137.245 memory Pass memory size is 32768MB 10.0.137.245 selinux Pass SELinux is disabled 10.0.137.245 os-version Pass OS is Amazon Linux 2 10.0.137.245 cpu-cores Pass number of CPU cores / threads: 8 10.0.137.245 cpu-governor Warn Unable to determine current CPU frequency governor policy 10.0.137.245 command Pass numactl: policy: default 10.0.137.245 timezone Pass time zone is the same as the first PD machine: UTC 10.0.137.245 thp Pass THP is disabled 10.0.137.245 service Pass service firewalld not found, ignore 10.0.141.19 os-version Pass OS is Amazon Linux 2 10.0.141.19 cpu-cores Pass number of CPU cores / threads: 8 10.0.141.19 cpu-governor Warn Unable to determine current CPU frequency governor policy 10.0.141.19 memory Pass memory size is 32768MB 10.0.141.19 service Pass service firewalld not found, ignore 10.0.141.19 timezone Fail invalid character 'S' looking for beginning of value 10.0.141.19 selinux Pass SELinux is disabled 10.0.141.19 thp Pass THP is disabled 10.0.141.19 command Pass numactl: policy: default 10.0.134.85 command Pass numactl: policy: default 10.0.134.85 os-version Pass OS is Amazon Linux 2 10.0.134.85 memory Pass memory size is 32768MB 10.0.134.85 service Pass service firewalld not found, ignore 10.0.134.85 selinux Pass SELinux is disabled 10.0.134.85 thp Pass THP is disabled 10.0.134.85 cpu-cores Pass number of CPU cores / threads: 8 10.0.134.85 cpu-governor Warn Unable to determine current CPU frequency governor policy 10.0.134.85 timezone Fail invalid character 'S' looking for beginning of value 10.0.131.156 service Pass service firewalld not found, ignore 10.0.131.156 command Pass numactl: policy: default 10.0.131.156 os-version Pass OS is Amazon Linux 2 10.0.131.156 cpu-cores Pass number of CPU cores / threads: 8 10.0.131.156 cpu-governor Warn Unable to determine current CPU frequency governor policy 10.0.131.156 memory Pass memory size is 32768MB 10.0.131.156 selinux Pass SELinux is disabled 10.0.131.156 thp Pass THP is disabled 10.0.138.103 os-version Pass OS is Amazon Linux 2 10.0.138.103 cpu-governor Warn Unable to determine current CPU frequency governor policy 10.0.138.103 timezone Pass time zone is the same as the first PD machine: UTC 10.0.138.103 thp Pass THP is disabled 10.0.138.103 service Pass service firewalld not found, ignore 10.0.138.103 cpu-cores Pass number of CPU cores / threads: 8 10.0.138.103 memory Pass memory size is 32768MB 10.0.138.103 selinux Pass SELinux is disabled 10.0.138.103 command Pass numactl: policy: default 10.0.128.24 cpu-cores Pass number of CPU cores / threads: 8 10.0.128.24 selinux Pass SELinux is disabled 10.0.128.24 os-version Pass OS is Amazon Linux 2 10.0.128.24 cpu-governor Warn Unable to determine current CPU frequency governor policy 10.0.128.24 memory Pass memory size is 32768MB 10.0.128.24 timezone Pass time zone is the same as the first PD machine: UTC 10.0.128.24 thp Pass THP is disabled 10.0.128.24 service Pass service firewalld not found, ignore 10.0.128.24 command Pass numactl: policy: default [ec2-user@ip-10-0-5-38 tiup_config]$

pingcap / tiup

tiup v1.10.0 gets `Error: failed to fetch cpu-arch or kernel-name: executor.ssh.execute_failed` #1913

Bug Report