search

alces-software / adminware

A sandbox CLI for running commands remotely across nodes
1 stars 0 forks source link

SSH errors on interrupt #177

Closed WilliamMcCumstie closed 5 years ago

WilliamMcCumstie commented 5 years ago

Sometimes when interrupting the connections, the following ssh error is spammed to the console. The can be over 100 repeats for the same error. I can not seem to replicate the error on a single node:

Interrupt Received! 
Cancelling the jobs...
Cleaning up...
Exception: Error reading SSH protocol banner[Errno 104] Connection reset by peer
Exception: Error reading SSH protocol banner[Errno 104] Connection reset by peer
Exception: Error reading SSH protocol banner[Errno 104] Connection reset by peer
Traceback (most recent call last):
  File "/host/adminware/venv/lib/python3.5/site-packages/paramiko/transport.py", line 2138, in _check_banner
    buf = self.packetizer.readline(timeout)
  File "/host/adminware/venv/lib/python3.5/site-packages/paramiko/packet.py", line 367, in readline
    buf += self._read_timeout(timeout)
  File "/host/adminware/venv/lib/python3.5/site-packages/paramiko/packet.py", line 561, in _read_timeout
    x = self.__socket.recv(128)
ConnectionResetError: [Errno 104] Connection reset by peer

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/host/adminware/venv/lib/python3.5/site-packages/paramiko/transport.py", line 1966, in run
    self._check_banner()
  File "/host/adminware/venv/lib/python3.5/site-packages/paramiko/transport.py", line 2143, in _check_banner
    "Error reading SSH protocol banner" + str(e)
paramiko.ssh_exception.SSHException: Error reading SSH protocol banner[Errno 104] Connection reset by peer

Traceback (most recent call last):
Exception: Error reading SSH protocol banner[Errno 104] Connection reset by peer
  File "/host/adminware/venv/lib/python3.5/site-packages/paramiko/transport.py", line 2138, in _check_banner
    buf = self.packetizer.readline(timeout)
Traceback (most recent call last):
Exception: Error reading SSH protocol banner[Errno 104] Connection reset by peer
Exception: Error reading SSH protocol banner[Errno 104] Connection reset by peer
Traceback (most recent call last):
  File "/host/adminware/venv/lib/python3.5/site-packages/paramiko/transport.py", line 2138, in _check_banner
    buf = self.packetizer.readline(timeout)
  File "/host/adminware/venv/lib/python3.5/site-packages/paramiko/packet.py", line 367, in readline
    buf += self._read_timeout(timeout)
  File "/host/adminware/venv/lib/python3.5/site-packages/paramiko/packet.py", line 561, in _read_timeout
    x = self.__socket.recv(128)
ConnectionResetError: [Errno 104] Connection reset by peer

During handling of the above exception, another exception occurred:
...
More SSH spam
DavidMarchant commented 5 years ago

With the merging of https://github.com/alces-software/adminware/pull/178 this is being considered closed until such a time that it re-rears its ugly head