search

hartator / wayback-machine-downloader

Download an entire website from the Wayback Machine.
Other
5.29k stars 699 forks source link

Unknown Error #70

Open Maik-Thiele opened 7 years ago

Maik-Thiele commented 7 years ago

It loads~4800 files and stoped.

C:/Ruby23/lib/ruby/gems/2.3.0/gems/wayback_machinedownloader-1.1.3/lib/wayback machine_downloader.rb:240:in rescue in download_file': incompatible character e ncodings: ASCII-8BIT and UTF-8 (Encoding::CompatibilityError) from C:/Ruby23/lib/ruby/gems/2.3.0/gems/wayback_machine_downloader-1.1.3 /lib/wayback_machine_downloader.rb:246:indownload_file' from C:/Ruby23/lib/ruby/gems/2.3.0/gems/wayback_machine_downloader-1.1.3 /lib/wayback_machine_downloader.rb:169:in `block (2 levels) in download_files'

C:\wayback>

hartator commented 7 years ago

Can you post the full command you are running?

Maik-Thiele commented 7 years ago

Sadly I closed it before ur answer, but here is the another one. Started with wayback_machine_downloader http://url.com --f 323232323

http://www.ogr.com:80/17inch_lcd_monitor/17-lcd-monitor-sale.php -> websites/www .ogr.com/17inch_lcd_monitor/17-lcd-monitor-sale.php (1524/15834) http://www.ogr.com:80/17inch_lcd_monitor/lcd-17-s?ljes.php # URI must be ascii o nly "http://web.archive.org/web/20051212142407id_/http://www.ogr.com:80/17inch_l cd_monitor/lcd-17-s\xE4ljes.php" websites/www.ogr.com/17inch_lcd_monitor/lcd-17-säljes.php was empty and was remo ved. C:/Ruby23/lib/ruby/gems/2.3.0/gems/wayback_machinedownloader-1.1.3/lib/wayback machine_downloader.rb:249:in block in download_file': incompatible character en codings: ASCII-8BIT and UTF-8 (Encoding::CompatibilityError) from C:/Ruby23/lib/ruby/gems/2.3.0/gems/wayback_machine_downloader-1.1.3 /lib/wayback_machine_downloader.rb:247:insynchronize' from C:/Ruby23/lib/ruby/gems/2.3.0/gems/wayback_machine_downloader-1.1.3 /lib/wayback_machine_downloader.rb:247:in download_file' from C:/Ruby23/lib/ruby/gems/2.3.0/gems/wayback_machine_downloader-1.1.3 /lib/wayback_machine_downloader.rb:169:inblock (2 levels) in download_files'

C:\wayback>

Downloaded 1,5k of 15k. Strange.