neoave / mrack

Multicloud use-case based multihost async provisioner for CIs and testing during development
Apache License 2.0
11 stars 14 forks source link

feat: check ssh connectivity outside of pares_error_hosts more than once #104

Closed Tiboris closed 3 years ago

Tiboris commented 3 years ago

feat: check ssh connectivity outside of pares_error_hosts more than once

Move the ssh connectivity check outside of the pares_error_hosts method to distinguish the functionality and to be able to gather asynchronous results later.

Retry the ssh connection after if fails to not destroy slower systems which may not have set up the proper ssh key into allowed keys.

Tiboris commented 3 years ago

after:

OpenStack: Waiting for all hosts to be active
OpenStack: Host c963a4fa-85e9-4204-862a-640f9c58b790 was provisioned in 312.4s
OpenStack: All hosts reached provisioning final state (ACTIVE or ERROR)
OpenStack: Provisioning duration: 0:05:15.144503
OpenStack: Waiting for the port 22 on host 10.0.106.24 to start accepting connections
OpenStack: Port 22 on host  10.0.106.24 is now open
ssh -o 'StrictHostKeyChecking=no' -o 'UserKnownHostsFile=/dev/null' -l Administrator -o 'PasswordAuthentication=no' -i config/id_rsa 10.0.106.24 echo mrack
Warning: Permanently added '10.0.106.24' (ECDSA) to the list of known hosts.
Administrator@10.0.106.24: Permission denied (publickey,password,keyboard-interactive).
ssh -o 'StrictHostKeyChecking=no' -o 'UserKnownHostsFile=/dev/null' -l Administrator -o 'PasswordAuthentication=no' -i config/id_rsa 10.0.106.24 echo mrack
Warning: Permanently added '10.0.106.24' (ECDSA) to the list of known hosts.
Administrator@10.0.106.24: Permission denied (publickey,password,keyboard-interactive).
ssh -o 'StrictHostKeyChecking=no' -o 'UserKnownHostsFile=/dev/null' -l Administrator -o 'PasswordAuthentication=no' -i config/id_rsa 10.0.106.24 echo mrack
Warning: Permanently added '10.0.106.24' (ECDSA) to the list of known hosts.
Administrator@10.0.106.24: Permission denied (publickey,password,keyboard-interactive).
ssh -o 'StrictHostKeyChecking=no' -o 'UserKnownHostsFile=/dev/null' -l Administrator -o 'PasswordAuthentication=no' -i config/id_rsa 10.0.106.24 echo mrack
Warning: Permanently added '10.0.106.24' (ECDSA) to the list of known hosts.
Administrator@10.0.106.24: Permission denied (publickey,password,keyboard-interactive).
ssh -o 'StrictHostKeyChecking=no' -o 'UserKnownHostsFile=/dev/null' -l Administrator -o 'PasswordAuthentication=no' -i config/id_rsa 10.0.106.24 echo mrack
Warning: Permanently added '10.0.106.24' (ECDSA) to the list of known hosts.
Administrator@10.0.106.24: Permission denied (publickey,password,keyboard-interactive).
ssh -o 'StrictHostKeyChecking=no' -o 'UserKnownHostsFile=/dev/null' -l Administrator -o 'PasswordAuthentication=no' -i config/id_rsa 10.0.106.24 echo mrack
Warning: Permanently added '10.0.106.24' (ECDSA) to the list of known hosts.
Administrator@10.0.106.24: Permission denied (publickey,password,keyboard-interactive).
ssh -o 'StrictHostKeyChecking=no' -o 'UserKnownHostsFile=/dev/null' -l Administrator -o 'PasswordAuthentication=no' -i config/id_rsa 10.0.106.24 echo mrack
Warning: Permanently added '10.0.106.24' (ECDSA) to the list of known hosts.
Administrator@10.0.106.24: Permission denied (publickey,password,keyboard-interactive).
ssh -o 'StrictHostKeyChecking=no' -o 'UserKnownHostsFile=/dev/null' -l Administrator -o 'PasswordAuthentication=no' -i config/id_rsa 10.0.106.24 echo mrack
Warning: Permanently added '10.0.106.24' (ECDSA) to the list of known hosts.
Administrator@10.0.106.24: Permission denied (publickey,password,keyboard-interactive).
ssh -o 'StrictHostKeyChecking=no' -o 'UserKnownHostsFile=/dev/null' -l Administrator -o 'PasswordAuthentication=no' -i config/id_rsa 10.0.106.24 echo mrack
Warning: Permanently added '10.0.106.24' (ECDSA) to the list of known hosts.
Administrator@10.0.106.24: Permission denied (publickey,password,keyboard-interactive).
ssh -o 'StrictHostKeyChecking=no' -o 'UserKnownHostsFile=/dev/null' -l Administrator -o 'PasswordAuthentication=no' -i config/id_rsa 10.0.106.24 echo mrack
Warning: Permanently added '10.0.106.24' (ECDSA) to the list of known hosts.
Administrator@10.0.106.24: Permission denied (publickey,password,keyboard-interactive).
ssh -o 'StrictHostKeyChecking=no' -o 'UserKnownHostsFile=/dev/null' -l Administrator -o 'PasswordAuthentication=no' -i config/id_rsa 10.0.106.24 echo mrack
Warning: Permanently added '10.0.106.24' (ECDSA) to the list of known hosts.
Administrator@10.0.106.24: Permission denied (publickey,password,keyboard-interactive).
ssh -o 'StrictHostKeyChecking=no' -o 'UserKnownHostsFile=/dev/null' -l Administrator -o 'PasswordAuthentication=no' -i config/id_rsa 10.0.106.24 echo mrack
Warning: Permanently added '10.0.106.24' (ECDSA) to the list of known hosts.
Administrator@10.0.106.24: Permission denied (publickey,password,keyboard-interactive).
ssh -o 'StrictHostKeyChecking=no' -o 'UserKnownHostsFile=/dev/null' -l Administrator -o 'PasswordAuthentication=no' -i config/id_rsa 10.0.106.24 echo mrack
Warning: Permanently added '10.0.106.24' (ECDSA) to the list of known hosts.
Administrator@10.0.106.24: Permission denied (publickey,password,keyboard-interactive).
ssh -o 'StrictHostKeyChecking=no' -o 'UserKnownHostsFile=/dev/null' -l Administrator -o 'PasswordAuthentication=no' -i config/id_rsa 10.0.106.24 echo mrack
Warning: Permanently added '10.0.106.24' (ECDSA) to the list of known hosts.
mrack
OpenStack: SSH to host '10.0.106.24' successful after 0:03:04.023620
OpenStack: Printing provisioned hosts
OpenStack: active c963a4fa-85e9-4204-862a-640f9c58b790 root-dc.ad.test 10.0.106.24 None None
Provisioning done
Output generation started
Created: config/test.inventory.yaml
Created: config/pytest-multihost-config.yaml
Output generation done
bhavikbhavsar commented 3 years ago

Tested successfully https://pastebin.com/sWPaV2N2. with fedora provisioning on beaker.