search

commoncrawl / news-crawl

News crawling with StormCrawler - stores content as WARC
Apache License 2.0
323 stars 35 forks source link

Upgrade to Storm 1.2.1 and ES 6.1.1 #20

Closed sebastian-nagel closed 6 years ago

sebastian-nagel commented 6 years ago

Storm-crawler is now based on Storm 1.2.1 and Elasticsearch 6.1.1, news-crawl should also be upgraded.

sebastian-nagel commented 6 years ago

Merged into master and tested on Docker with ES 6.1.1 and also the most recent 6.2.2.

jnioche commented 6 years ago

@sebastian-nagel did you see this PR? Would be fab to get some feedback / tests on it if you can.

sebastian-nagel commented 6 years ago

Thanks. Too late, I'll integrate it in the next deployment cycle.