search

machawk1 / warcreate

Chrome extension to "Create WARC files from any webpage"
https://warcreate.com
MIT License
206 stars 13 forks source link

Plain text files on the web break WARC creation processed #60

Closed machawk1 closed 10 years ago

machawk1 commented 10 years ago

As reported by @phonedude. Verification of this is needed in the latest version.

machawk1 commented 10 years ago

e.g., http://www.cs.odu.edu/~mln/pubs/bio.txt

machawk1 commented 10 years ago

VERIFIED with 0.2014.07.25 produced http://www.cs.odu.edu/~mkelly/semester/2014_summer/20140728180142990.warc which webrecorder pukes on. Further validation needed to see if this is replayable in Wayback.

machawk1 commented 10 years ago

Compared to webrecorder.io: http://www.cs.odu.edu/~mkelly/semester/2014_summer/MLN_bio_webrecorder.warc

machawk1 commented 10 years ago

Fixed with content-length re-calculation.