Enhance Github API Key Handling

[ABrain7710]

Key Manager Logic

• Handle Key Request
  • Check if any expired keys are now valid
  • Pick random key and send key response on redis channel
  • If no valid keys available send key response that indicates no keys are available with the time to sleep
• Handle Key Expired
  • Move key from ready list to expired keys list

Celery Worker

• Retrieve a new key

  • Publish request for key
  • Poll for response
  • When success response is received on the channel use it
  • When no keys available error response is received on the channel sleep for the time indicated then request again

• Key runs out of requests

  • Send message on channel that the key has expired
  • Retrieve a new key

[Ulincsys]

KeyClient superclass description:

class KeyClient:
    def get_key(self, ...): ...
    def expire_key(self, key, ...): ...