hartator / wayback-machine-downloader

Download an entire website from the Wayback Machine.
Other
5.36k stars 714 forks source link

Getting snapshot pages.C:/Ruby30-x64/lib/ruby/3.0.0/open-uri.rb:364:in `open_http': 504 Gateway Time-out (OpenURI::HTTPError) #303

Open FarrazR opened 4 months ago

FarrazR commented 4 months ago

wayback_machine_downloader http://example.com

i try using this and the result is

Downloading http://example.com to websites/example.com/ from Wayback Machine archives.

Getting snapshot pages.C:/Ruby30-x64/lib/ruby/3.0.0/open-uri.rb:364:in open_http': 504 Gateway Time-out (OpenURI::HTTPError) from C:/Ruby30-x64/lib/ruby/3.0.0/open-uri.rb:741:inbuffer_open' from C:/Ruby30-x64/lib/ruby/3.0.0/open-uri.rb:212:in block in open_loop' from C:/Ruby30-x64/lib/ruby/3.0.0/open-uri.rb:210:incatch' from C:/Ruby30-x64/lib/ruby/3.0.0/open-uri.rb:210:in open_loop' from C:/Ruby30-x64/lib/ruby/3.0.0/open-uri.rb:151:inopen_uri' from C:/Ruby30-x64/lib/ruby/3.0.0/open-uri.rb:721:in open' from C:/Ruby30-x64/lib/ruby/gems/3.0.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader/archive_api.rb:13:inget_raw_list_from_api' from C:/Ruby30-x64/lib/ruby/gems/3.0.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:92:in block in get_all_snapshots_to_consider' from C:/Ruby30-x64/lib/ruby/gems/3.0.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:intimes' from C:/Ruby30-x64/lib/ruby/gems/3.0.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:in get_all_snapshots_to_consider' from C:/Ruby30-x64/lib/ruby/gems/3.0.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:105:inget_file_list_curated' from C:/Ruby30-x64/lib/ruby/gems/3.0.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:164:in get_file_list_by_timestamp' from C:/Ruby30-x64/lib/ruby/gems/3.0.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:309:infile_list_by_timestamp' from C:/Ruby30-x64/lib/ruby/gems/3.0.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:192:in download_files' from C:/Ruby30-x64/lib/ruby/gems/3.0.0/gems/wayback_machine_downloader-2.3.1/bin/wayback_machine_downloader:72:in<top (required)>' from C:/Ruby30-x64/bin/wayback_machine_downloader:25:in load' from C:/Ruby30-x64/bin/wayback_machine_downloader:25:in

'

intercoop commented 4 months ago

same issue

jlonge421 commented 3 months ago

Same issue, attempted on both os X & Windows

felfoldi96 commented 3 months ago

same issue

MurmeltierS commented 3 months ago

same issue

AppleONE-alt commented 2 months ago

same issue

dmikhaylov commented 2 days ago

Well, I've noticed the same problem on both Windows and Linux. It obviously doesn't work anymore.