Keep track of requests to avoid hitting the rate limit

[Crecket]

Either block the request completely or delay it for a maximum of X milliseconds