jsvine / waybackpack

Download the entire Wayback Machine archive for a given URL.
MIT License
2.8k stars 189 forks source link

generate list failed with `to_json': source sequence is illegal/malformed utf-8 #46

Closed wenerme closed 2 years ago

wenerme commented 2 years ago
/build/lib/wayback_machine_downloader.rb:182:in `to_json': source sequence is illegal/malformed utf-8 (JSON::GeneratorError)
        from /build/lib/wayback_machine_downloader.rb:182:in `block in list_files'
        from /build/lib/wayback_machine_downloader.rb:181:in `each'
        from /build/lib/wayback_machine_downloader.rb:181:in `list_files'
        from /build/bin/wayback_machine_downloader:70:in `<top (required)>'
        from /usr/local/bundle/bin/wayback_machine_downloader:17:in `load'
        from /usr/local/bundle/bin/wayback_machine_downloader:17:in `<main>'

seems some url contain some invalid % escape sequence

jsvine commented 2 years ago

I think you may have accidentally opened this issue in the wrong repository. This repository is waybackpack, and the code is written entirely in Python. The stack trace in your comment refers to a Ruby file, and has a different project name. Maybe you're looking for this?: https://github.com/hartator/wayback-machine-downloader

wenerme commented 2 years ago

@jsvine sorry