Closed sylvinus closed 8 years ago
Just announced: http://blog.commoncrawl.org/2016/02/february-2016-crawl-archive-now-available/
Should be rather easy to switch in the code: https://github.com/commonsearch/cosr-back/blob/master/scripts/import_commoncrawl.sh#L13
Just announced: http://blog.commoncrawl.org/2016/02/february-2016-crawl-archive-now-available/
Should be rather easy to switch in the code: https://github.com/commonsearch/cosr-back/blob/master/scripts/import_commoncrawl.sh#L13