balena-os / leviathan

A distributed hardware testing framework
https://balena-os.github.io/leviathan
Apache License 2.0
23 stars 6 forks source link

add logging for ssh error and stop conn resets during reboot command #1028

Open rcooke-warwick opened 1 year ago

rcooke-warwick commented 1 year ago

two issues that popped up when there were connection failures following a reboot of the DUT (beaglebone)

  1. We can't see what failed
  2. when doing rebootDut the reboot can interrupt the ssh connection which leads to a loop of reboots

This PR increases the delay on the reboot command so that there's time for the ssh command to end first, stopping the loop of retrying the command. We also log the failed command if the ssh command fails.