hartator / wayback-machine-downloader

Download an entire website from the Wayback Machine.
Other
5.29k stars 699 forks source link

Need Help: Getting this Error: `open_http': 400 BAD REQUEST #307

Open hupictz opened 2 days ago

hupictz commented 2 days ago

Getting snapshot pages.../System/Library/Frameworks/Ruby.framework/Versions/2.3/usr/lib/ruby/2.3.0/open-uri.rb:359:in open_http': 400 BAD REQUEST (OpenURI::HTTPError) from /System/Library/Frameworks/Ruby.framework/Versions/2.3/usr/lib/ruby/2.3.0/open-uri.rb:737:inbuffer_open' from /System/Library/Frameworks/Ruby.framework/Versions/2.3/usr/lib/ruby/2.3.0/open-uri.rb:212:in block in open_loop' from /System/Library/Frameworks/Ruby.framework/Versions/2.3/usr/lib/ruby/2.3.0/open-uri.rb:210:incatch' from /System/Library/Frameworks/Ruby.framework/Versions/2.3/usr/lib/ruby/2.3.0/open-uri.rb:210:in open_loop' from /System/Library/Frameworks/Ruby.framework/Versions/2.3/usr/lib/ruby/2.3.0/open-uri.rb:151:inopen_uri' from /System/Library/Frameworks/Ruby.framework/Versions/2.3/usr/lib/ruby/2.3.0/open-uri.rb:717:in open' from /Library/Ruby/Gems/2.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader/archive_api.rb:13:inget_raw_list_from_api' from /Library/Ruby/Gems/2.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:92:in block in get_all_snapshots_to_consider' from /Library/Ruby/Gems/2.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:intimes' from /Library/Ruby/Gems/2.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:in get_all_snapshots_to_consider' from /Library/Ruby/Gems/2.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:105:inget_file_list_curated' from /Library/Ruby/Gems/2.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:164:in get_file_list_by_timestamp' from /Library/Ruby/Gems/2.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:309:infile_list_by_timestamp' from /Library/Ruby/Gems/2.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:192:in download_files' from /Library/Ruby/Gems/2.3.0/gems/wayback_machine_downloader-2.3.1/bin/wayback_machine_downloader:72:in<top (required)>' from /usr/local/bin/wayback_machine_downloader:22:in load' from /usr/local/bin/wayback_machine_downloader:22:in

'

tokiyui commented 1 day ago

I also found a similar error.

$ wayback_machine_downloader http://www.ogurayui.jp/ Downloading http://www.ogurayui.jp/ to websites/www.ogurayui.jp/ from Wayback Machine archives.

Getting snapshot pages....../usr/share/ruby/open-uri.rb:364:in open_http': 400 BAD REQUEST (OpenURI::HTTPError) from /usr/share/ruby/open-uri.rb:741:inbuffer_open' from /usr/share/ruby/open-uri.rb:212:in block in open_loop' from /usr/share/ruby/open-uri.rb:210:incatch' from /usr/share/ruby/open-uri.rb:210:in open_loop' from /usr/share/ruby/open-uri.rb:151:inopen_uri' from /usr/share/ruby/open-uri.rb:721:in open' from /home/user/.local/share/gem/ruby/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader/archive_api.rb:13:inget_raw_list_from_api' from /home/user/.local/share/gem/ruby/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:92:in block in get_all_snapshots_to_consider' from /home/user/.local/share/gem/ruby/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:intimes' from /home/user/.local/share/gem/ruby/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:in get_all_snapshots_to_consider' from /home/user/.local/share/gem/ruby/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:105:inget_file_list_curated' from /home/user/.local/share/gem/ruby/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:164:in get_file_list_by_timestamp' from /home/user/.local/share/gem/ruby/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:309:infile_list_by_timestamp' from /home/user/.local/share/gem/ruby/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:192:in download_files' from /home/user/.local/share/gem/ruby/gems/wayback_machine_downloader-2.3.1/bin/wayback_machine_downloader:72:in<top (required)>' from /home/user/bin/wayback_machine_downloader:25:in load' from /home/user/bin/wayback_machine_downloader:25:in

'

intercoop commented 6 hours ago

same issue !