Yelp / mrjob

Run MapReduce jobs on Hadoop or Amazon Web Services
http://packages.python.org/mrjob/
Other
2.62k stars 586 forks source link

integrate describe_cluster() calls with cluster cache #2186

Open coyotemarin opened 4 years ago

coyotemarin commented 4 years ago

We've made a tremendous effort to reduce the number of API calls used by cluster pooling, but we still sometimes describe a cluster without saving information about it to our cluster cache, which saves immutable information about a cluster (e.g. image version).