issues
search
rossf7
/
elasticrawl
Launch AWS Elastic MapReduce jobs that process Common Crawl data.
MIT License
49
stars
13
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Update bundler version
#26
rossf7
closed
7 years ago
0
EMR instantiation will fail without explicitly specified subnet
#25
e271828-
opened
7 years ago
0
Support EC2 subnet id in config. (Required for new AWS acccounts.)
#24
e271828-
closed
7 years ago
1
Correct WARC paths in test data to match new S3 location.
#23
rossf7
closed
8 years ago
0
correcting the segments name, and bumping version to 1.1.7
#22
samhumeau
closed
8 years ago
1
Bad segments using latest CommonCrawl path
#21
laxatives
closed
8 years ago
4
S3bucket
#20
rossf7
closed
8 years ago
0
Support new Common Crawl location s3://commoncrawl/
#19
rossf7
closed
8 years ago
1
Added support for Elasticity's ec2_subnet_id parameter.
#18
aantix
closed
8 years ago
0
Can this be used for other sites?
#17
JasonDD
closed
8 years ago
0
Update README.md
#16
rossf7
closed
8 years ago
0
Version updates
#15
rossf7
closed
8 years ago
0
Add default instance profile and service profile and fix unit tests
#14
Hydrotoast
closed
9 years ago
0
Fix the rake tests
#13
benmccann
closed
9 years ago
2
Read credentials from ~/.aws/credentials when available
#12
benmccann
closed
5 years ago
2
Add info about the May 2015 crawl archive
#11
benmccann
closed
9 years ago
1
Issues running parse
#10
ryanrussell
closed
8 years ago
7
Add January 2015 crawl to README
#9
rossf7
closed
9 years ago
0
Remove Ruby 1.9.3 support from Vagrant and Travis CI
#8
rossf7
closed
9 years ago
0
Update CHANGELOG.md
#7
rossf7
closed
9 years ago
0
Upgrade Traveling Ruby to 20150204-2.1.5
#6
rossf7
closed
9 years ago
0
Fix error handling bug
#5
rossf7
closed
9 years ago
0
Improve error handling for S3 API calls
#4
rossf7
closed
9 years ago
0
ruby version important?
#3
stedy
closed
9 years ago
4
Install from deploy packages rather than RubyGems
#2
rossf7
closed
9 years ago
0
File counts
#1
rossf7
closed
9 years ago
0