jsonlines usage - Githubissues

VasssilPopov / AllSpiders

Some spiders

0 stars 3 forks source link

Closed VasssilPopov closed 7 years ago

VasssilPopov commented 7 years ago

How to use it?

what is file extension for reports still .json or .jl or *. jsonlines or something else

So the call spider execution will be:
scrapy runspider -o Mediapool2017-05-10.js -t jsonlines

peio commented 7 years ago

It is still .json. This is why in the read_json fucntion, we check what the format is and read it accordingly: https://github.com/VasssilPopov/AllSpiders/blob/master/_LIBRARY/ScrapingHelpers.py#L11