search

lintool / warcbase

Warcbase is an open-source platform for managing analyzing web archives
http://warcbase.org/
161 stars 47 forks source link

More robust tweet parsing #225

Closed lintool closed 8 years ago

lintool commented 8 years ago

When parsing a file of JSON tweets, mangled/invalid JSON lines cause entire jobs to fail. Need more robust handling of JSON parsing errors.

lintool commented 8 years ago

Fixed commit 0c850642f7892cde59069c956a938787480f0bb1