search

eugeneware / warc

Parse WARC (Web Archive Files) as a node.js stream
Other
22 stars 8 forks source link

Unable to parse ClueWeb09 #1

Open dod91 opened 9 years ago

dod91 commented 9 years ago

Hi, I'm trying to read the ClueWeb09 warc file but there is not data emitted nor error. It seems that ClueWeb's separator is different from standard warc files, I have forked this repository for changing it but headers are sometimes not parsed correctly.
I was wondering if you could help me out, thank you.

herkyl commented 8 years ago

:+1: No data events for me as well