ArchiveTeam / wpull

Wget-compatible web downloader and crawler.
GNU General Public License v3.0
545 stars 77 forks source link

FTP processor may start retrieval before logging the `Fetching` message #473

Open JustAnotherArchivist opened 1 year ago

JustAnotherArchivist commented 1 year ago

ArchiveBot jobs 7lcu33qq8xz34qiz041cwuijq and 73yb4vtrctfozf8ygum38wdmt recently crashed with an AuthenticationError on an FTP URL like ftp://cnbc.upload.akamai.com/h/VCPS/Y2022/M04D11/7000242098/1649705765-22533050273-hd_flv_432x240_30p_500k.flv. The error obviously happened during login, but the log file does not mention the FTP URL being attempted at all. It appears that the Fetching ‘URL’ log message is not generated when starting the retrieval.