Yelp / mrjob

Run MapReduce jobs on Hadoop or Amazon Web Services
http://packages.python.org/mrjob/
Other
2.62k stars 586 forks source link

support docker on EMR 6.x AMIs #2179

Closed coyotemarin closed 4 years ago

coyotemarin commented 4 years ago

EMR now has explicit support for Docker on 6.x AMIs. mrjob should integrate with this

coyotemarin commented 4 years ago

Probably should add the following options:

coyotemarin commented 4 years ago

Magic mrjob can provide:

coyotemarin commented 4 years ago

We'll need to bootstrap mrjob in setup if we want to be able to access it inside Docker.