[TODO] Implement client-side rate-limited queue (throttle or burst HTTP requests to GitHub API)

[webknjaz]

Some kind of a leaky bucket seems to be appropriate here. It should take into account the overall rate limit, remaining rate limit and retry-after reported by GitHub API.

Prior art:

• https://github.com/litl/backoff / https://pypi.org/project/backoff/ (this is more about retries rather rate-limiting but is still a related topic)
• https://github.com/hallazzang/asyncio-throttle/blob/master/asyncio_throttle.py
• https://quentin.pradet.me/blog/how-do-you-rate-limit-calls-with-aiohttp.html
• https://gist.github.com/pquentin/5d8f5408cdad73e589d85ba509091741
• https://github.com/ccxt/ccxt/blob/master/python/ccxt/async_support/base/throttle.py
• https://github.com/ccxt/ccxt/pull/373/files
• https://stackoverflow.com/questions/45440900/throttling-async-functions-in-python-asyncio
• https://en.wikipedia.org/wiki/Leaky_bucket
• https://en.wikipedia.org/wiki/Token_bucket

[webknjaz]

Ref: https://github.com/octokit/plugin-throttling.js

[webknjaz]

https://github.com/chdsbd/kodiak/blob/0de6ed7/bot/kodiak/throttle.py

[webknjaz]

https://github.com/chdsbd/kodiak/pull/196

[webknjaz]

https://github.com/chdsbd/kodiak/pull/70