Open anfranken opened 4 years ago
Settings:
[x] url: www.spiegel.de
blacklist:
[x] follow subdomain: off https://github.com/anfranken/news-scrap/blob/bc9e49a969db584b7e8509316807e78ddc9664cd/config/sitelist.hjson#L9
[x] period: 01.01.2013 - 31.12.2016 https://github.com/anfranken/news-scrap/blob/bf1205f50226a81844501ffaa8492a68dcfc6829/config/config.cfg#L263-L264
[x] speed for test: slow :) https://github.com/anfranken/news-scrap/blob/bf1205f50226a81844501ffaa8492a68dcfc6829/config/config.cfg#L307 https://github.com/anfranken/news-scrap/blob/bf1205f50226a81844501ffaa8492a68dcfc6829/config/config.cfg#L311
Name of Crawler: ??? Settings: