search

nrabinowitz / pjscrape

A web-scraping framework written in Javascript, using PhantomJS and jQuery
http://nrabinowitz.github.io/pjscrape/
MIT License
996 stars 159 forks source link

Batch writing to file broken #35

Open Botono opened 11 years ago

Botono commented 11 years ago

The configuration field batchSize is essentially ignored as the file writer's write() method clears the file every time it is called. If a script crashes all data is lost.