search

hartator / wayback-machine-downloader

Download an entire website from the Wayback Machine.
Other
5.16k stars 677 forks source link

Error while "Getting snapshot pages..." #277

Open techana opened 5 months ago

techana commented 5 months ago

The script failed while "Getting snapshot pages..." and gave the error message:

/System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:949:in 'rescue in block in connect': Failed to open TCP connection to web.archive.org:443 (Connection refused - connect(2) for "web.archive.org" port 443) (Errno::ECONNREFUSED)

I've already applied the "sleep(3)" and the "persistent http connection" mods mentioned in other issues here, but that didn't help. I think the reason is that the website I'm trying to download is huge, and the WBM blocks the connection while getting the big files list before even start downloading anything!

jere-co commented 5 months ago

Did you apply the second sleep as well? https://github.com/hartator/wayback-machine-downloader/issues/273#issuecomment-1902073976

techana commented 5 months ago

Thank you for the comment. I've applied the second sleep just now and it seems to be working. I'll wait and see if it completes downloading all the required files.

jd-inferq commented 4 months ago

Hey do I have to git clone apply sleep and build? There are no build instructions?