Support new Common Crawl location s3://commoncrawl/

rossf7 / elasticrawl

Launch AWS Elastic MapReduce jobs that process Common Crawl data.

MIT License

49 stars 13 forks source link

Closed rossf7 closed 8 years ago

rossf7 commented 8 years ago

More details from this CommonCrawl user group post

rossf7 commented 8 years ago

The new S3 locations are supported in v1.1.7 of the Gem.