-
`Hi guys,
apperantly I get this issue, and I dont understand the meaning, because I tried to reduce the maxtoken, but it didnt work...any idea? (I did already the indexing)
INFO: Reading settin…
-
| | |
|--------------------|----|
| Bugzilla Link | [PR32541](https://bugs.llvm.org/show_bug.cgi?id=32541) |
| Status | NEW |
| Importance | P enhancemen…
-
### Do you need to file an issue?
- [X] I have searched the existing issues and this bug is not already filed.
- [ ] My model is hosted on OpenAI or Azure. If not, please look at the "model providers…
-
-
Looking through src/chilli.c, it appears that there is a mismatch between the way that the upload and download bandwidth limits are handled. The download version is as follows:
https://github.com/co…
-
**Description:**
The Rate Limiting design pattern is crucial in a microservices architecture to prevent abuse and ensure fair usage of resources. This pattern restricts the number of requests a servic…
-
**Is your feature request related to a problem? Please describe.**
When interacting with an external API that has a rate limiter implemented, it is important to have a matching rate limiter so that r…
-
- [Uber's leaky-bucket ratelimit](https://github.com/uber-go/ratelimit)
- [Netflix zuul's features](https://github.com/Netflix/zuul/wiki)
- [Kong - Nginx/Openresty](https://github.com/Kong/kong)
- …
-
Is it possible to build in an automatic throttling of API calls to avoid the too many requests error? There are many other implementations of the leaky bucket algorithm.
Basically, if the API resp…
-
Some kind of a leaky bucket seems to be appropriate here. It should take into account the overall rate limit, remaining rate limit and retry-after reported by GitHub API.
Prior art:
- https://gith…