sverch / butter

Dang. (NOTE: This project has moved to https://github.com/getcloudless/cloudless)
Other
5 stars 0 forks source link

Debug AWS timeouts and connection refused on parallel test runs #30

Open sverch opened 6 years ago

sverch commented 6 years ago

When trying to run tests in parallel, I started getting timeouts and connection resets when hitting the AWS API, which makes me wonder if AWS has some agressive rate limiting rules.

Should figure out when that happens/try to reproduce it. Probably by turning on debugging so that boto logs every request, and then trying to create a minimal test case that triggers these rate limits.

Once I figure out how I want to respond, I can catch the timeouts and resets using: https://stackoverflow.com/questions/16511337/correct-way-to-try-except-using-python-requests-module https://stackoverflow.com/questions/22629551/socket-timeout-timed-out-python-requests#25731542