Yelp / mrjob

Run MapReduce jobs on Hadoop or Amazon Web Services
http://packages.python.org/mrjob/
Other
2.62k stars 586 forks source link

upgrade boto3/botocore to support StepConcurrencyLevel #2193

Closed coyotemarin closed 3 years ago

coyotemarin commented 4 years ago

Old versions of boto3/botocore don't support the StepConcurrencyLevel parameter to RunJobFlow. Need to find which version of boto3/botocore introduced support for it, and bump requirements accordingly.

coyotemarin commented 3 years ago

Seems like we need botocore>=1.13.26 (can't launch a cluster with 1.13.25).

coyotemarin commented 3 years ago

Which means we need boto3>=1.10.0