ipsingh06 / seedsync

Sync your seedbox. Fast. And more.
https://ipsingh06.github.io/seedsync/
Apache License 2.0
312 stars 43 forks source link

LftpJobStateParser error: Missing queue header line 1: [?2004l, ['\x1b[?2004h'] #117

Open jonatino opened 2 years ago

jonatino commented 2 years ago

Running in docker latest version. Seems to be non-unicode characters in commands/outputs?

2022/03/16 02:11:18 - DEBUG - seedsync.ControllerJob - Thread ControllerJob started
2022/03/16 02:11:18 - DEBUG - seedsync.ControllerJob - Calling setup for ControllerJob
2022/03/16 02:11:18 - DEBUG - seedsync.WebAppJob - Thread WebAppJob started
2022/03/16 02:11:18 - DEBUG - seedsync.Controller - Starting controller
2022/03/16 02:11:18 - DEBUG - seedsync.WebAppJob - Calling setup for WebAppJob
2022/03/16 02:11:18 - DEBUG - seedsync.WebAppJob - Finished setup for WebAppJob
2022/03/16 02:11:18 - DEBUG - seedsync.Controller.MPLogger - Started listener thread
2022/03/16 02:11:18 - DEBUG - seedsync.ControllerJob - Finished setup for ControllerJob
2022/03/16 02:11:18 - DEBUG - seedsync.Controller.Lftp - command kekw: jobs -v
2022/03/16 02:11:18 - DEBUG - seedsync.Controller.Lftp - out (26 bytes): jobs -v [?2004l [?2004h
2022/03/16 02:11:19 - DEBUG - seedsync.Controller.Lftp - after: lftp jonatino@emerald.usbx.me:~>
2022/03/16 02:11:19 - WARNING - seedsync.Controller.Lftp - Wtf is this (out=jobs -v [?2004l [?2004h)
2022/03/16 02:11:19 - ERROR - seedsync.Controller.Lftp.LftpJobStatusParser - LftpJobStateParser error: Missing queue header line 1: [?2004l, ['\x1b[?2004h']
2022/03/16 02:11:19 - ERROR - seedsync.Controller.Lftp.LftpJobStatusParser - Status: jobs -v [?2004l [?2004h
2022/03/16 02:11:19 - WARNING - seedsync.Controller.Lftp - Ignoring status error (count=1)
2022/03/16 02:11:18 - DEBUG - ActiveScanner - Started process
2022/03/16 02:11:18 - DEBUG - RemoteScanner - Started process
2022/03/16 02:11:18 - DEBUG - RemoteScanner - Running a scan
2022/03/16 02:11:18 - DEBUG - LocalScanner - Started process
2022/03/16 02:11:18 - DEBUG - LocalScanner - Running a scan
2022/03/16 02:11:18 - DEBUG - LocalScanner - Scan took 0.001s
2022/03/16 02:11:18 - DEBUG - ExtractProcess - Started process
2022/03/16 02:11:18 - DEBUG - ExtractDispatch - Started worker thread
2022/03/16 02:11:19 - DEBUG - RemoteScanner.RemoteScanner - Local scanfs md5sum = 793e183bcc9e26d70a3b7ff62d847704
2022/03/16 02:11:19 - DEBUG - RemoteScanner.RemoteScanner.Sshcp - Command: ssh -p 22 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o LogLevel=error -o PubkeyAuthentication=no jonatino@emerald.usbx.me "md5sum /home14/jonatino/files/seedsynctmp/scanfs | awk '{print $1}' || echo"
2022/03/16 02:11:19 - DEBUG - seedsync.Controller.Lftp - command kekw: jobs -v
2022/03/16 02:11:19 - DEBUG - seedsync.Controller.Lftp - out (26 bytes): jobs -v [?2004l [?2004h
2022/03/16 02:11:19 - DEBUG - seedsync.Controller.Lftp - after: lftp jonatino@emerald.usbx.me:~>
2022/03/16 02:11:19 - WARNING - seedsync.Controller.Lftp - Wtf is this (out=jobs -v [?2004l [?2004h)
2022/03/16 02:11:19 - ERROR - seedsync.Controller.Lftp.LftpJobStatusParser - LftpJobStateParser error: Missing queue header line 1: [?2004l, ['\x1b[?2004h']
2022/03/16 02:11:19 - ERROR - seedsync.Controller.Lftp.LftpJobStatusParser - Status: jobs -v [?2004l [?2004h
2022/03/16 02:11:19 - WARNING - seedsync.Controller.Lftp - Ignoring status error (count=2)
2022/03/16 02:11:19 - DEBUG - seedsync.Controller.Model - LftpModel: Adding a listener
2022/03/16 02:11:20 - DEBUG - seedsync.Controller.Lftp - command kekw: jobs -v
2022/03/16 02:11:20 - DEBUG - seedsync.Controller.Lftp - out (26 bytes): jobs -v [?2004l [?2004h
2022/03/16 02:11:20 - DEBUG - seedsync.Controller.Lftp - after: lftp jonatino@emerald.usbx.me:~>
2022/03/16 02:11:20 - WARNING - seedsync.Controller.Lftp - Wtf is this (out=jobs -v [?2004l [?2004h)
2022/03/16 02:11:20 - ERROR - seedsync.Controller.Lftp.LftpJobStatusParser - LftpJobStateParser error: Missing queue header line 1: [?2004l, ['\x1b[?2004h']
2022/03/16 02:11:20 - ERROR - seedsync.Controller.Lftp.LftpJobStatusParser - Status: jobs -v [?2004l [?2004h
2022/03/16 02:11:20 - ERROR - seedsync.ControllerJob - Caught exception in job ControllerJob
Traceback (most recent call last):
File "/app/python/lftp/job_status_parser.py", line 89, in parse
statuses += self.__parse_queue(lines)
File "/app/python/lftp/job_status_parser.py", line 494, in __parse_queue
raise ValueError("Missing queue header line 1: {}, {}".format(line, lines))
ValueError: Missing queue header line 1: [?2004l, ['\x1b[?2004h']

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/app/python/common/job.py", line 44, in run
self.execute()
File "/app/python/controller/controller_job.py", line 29, in execute
self.__controller.process()
File "/app/python/controller/controller.py", line 202, in process
self.__update_model()
File "/app/python/controller/controller.py", line 295, in __update_model
lftp_statuses = self.__lftp.status()
File "/app/python/lftp/lftp.py", line 323, in status
statuses = self.__job_status_parser.parse(out)
File "/app/python/lftp/job_status_parser.py", line 94, in parse
raise LftpJobStatusParserError("Error parsing lftp job status")
lftp.job_status_parser.LftpJobStatusParserError: Error parsing lftp job status
2022/03/16 02:11:20 - DEBUG - seedsync.ControllerJob - Calling cleanup for ControllerJob
2022/03/16 02:11:20 - DEBUG - seedsync.Controller - Exiting controller
2022/03/16 02:11:20 - DEBUG - seedsync.Controller.Lftp - command kekw: queue -d *
2022/03/16 02:11:20 - DEBUG - seedsync.Controller.Lftp - out (57 bytes): queue -d * [?2004l queue: No queue is active. [?2004h
2022/03/16 02:11:20 - DEBUG - seedsync.Controller.Lftp - after: lftp jonatino@emerald.usbx.me:~>
2022/03/16 02:11:20 - DEBUG - seedsync.Controller.Lftp - command kekw: kill all
2022/03/16 02:11:20 - DEBUG - seedsync.Controller.Lftp - out (27 bytes): kill all [?2004l [?2004h
2022/03/16 02:11:20 - DEBUG - seedsync.Controller.Lftp - after: lftp jonatino@emerald.usbx.me:~>
2022/03/16 02:11:20 - ERROR - seedsync - Caught exception
Traceback (most recent call last):
File "/app/python/lftp/job_status_parser.py", line 89, in parse
statuses += self.__parse_queue(lines)
File "/app/python/lftp/job_status_parser.py", line 494, in __parse_queue
raise ValueError("Missing queue header line 1: {}, {}".format(line, lines))
ValueError: Missing queue header line 1: [?2004l, ['\x1b[?2004h']

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/app/python/seedsync.py", line 164, in run
controller_job.propagate_exception()
File "/app/python/common/job.py", line 77, in propagate_exception
raise exc_info[1].with_traceback(exc_info[2])
File "/app/python/common/job.py", line 44, in run
self.execute()
File "/app/python/controller/controller_job.py", line 29, in execute
self.__controller.process()
File "/app/python/controller/controller.py", line 202, in process
self.__update_model()
File "/app/python/controller/controller.py", line 295, in __update_model
lftp_statuses = self.__lftp.status()
File "/app/python/lftp/lftp.py", line 323, in status
statuses = self.__job_status_parser.parse(out)
File "/app/python/lftp/job_status_parser.py", line 94, in parse
raise LftpJobStatusParserError("Error parsing lftp job status")
lftp.job_status_parser.LftpJobStatusParserError: Error parsing lftp job status
2022/03/16 02:11:20 - DEBUG - RemoteScanner.RemoteScanner.Sshcp - Return code: 0
2022/03/16 02:11:20 - DEBUG - RemoteScanner.RemoteScanner.Sshcp - Command took 1.609s
2022/03/16 02:11:20 - INFO - RemoteScanner.RemoteScanner - Installing local:/app/scanfs to remote:/home14/jonatino/files/seedsynctmp/scanfs
2022/03/16 02:11:20 - DEBUG - RemoteScanner.RemoteScanner.Sshcp - Command: scp -q -P 22 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o LogLevel=error -o PubkeyAuthentication=no /app/scanfs jonatino@emerald.usbx.me:/home14/jonatino/files/seedsynctmp/scanfs
2022/03/16 02:11:20 - DEBUG - ActiveScanner - Process received terminate flag
2022/03/16 02:11:20 - DEBUG - ActiveScanner - Exiting process
2022/03/16 02:11:22 - DEBUG - ExtractProcess - Process received terminate flag
2022/03/16 02:11:23 - DEBUG - seedsync.Controller.MPLogger - Stopped listener thread
2022/03/16 02:11:23 - INFO - seedsync.Controller - Exited controller
2022/03/16 02:11:23 - DEBUG - seedsync.ControllerJob - Finished cleanup for ControllerJob
2022/03/16 02:11:23 - DEBUG - seedsync.ControllerJob - Thread ControllerJob stopped
2022/03/16 02:11:48 - DEBUG - seedsync - Persisting states to file