awslabs / amazon-ebs-autoscale

Don't run out of disk space on your EC2 instance when generating or working with large files. Automatically add EBS volumes to a filesystem mount point in response to disk utilization.
MIT License
111 stars 60 forks source link

limit Describevolume requests #29

Closed kmavrommatis closed 3 years ago

kmavrommatis commented 3 years ago

Description of changes: The current script when executed sends frequent DescribeVolume requests to the AWS API. When many nodes are doing the same the requests exceed the API limits. The suggested version has a restructured ebs-autoscale script that limits the number of DescribeVolume requests. In our environment with typically 1000s of running batch nodes this script has been working well, however, I don't know if there are scenarios that it would not which we have not tested. Thanks for considering.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

wleepang commented 3 years ago

Looks great! Thanks for the addition!