-
### What happened?
My use case is that I have a node running 3 llama.cpp server instances which I want to load balance with litellm. For the load balancer, I want the most simple setup possible. This…
-
Suggestion: Take the URL that is inserted into the Server field of the webstart.jnlp from the RequestURL, so when using Docker with a different port mapping or a reverse proxy, there's no need to chan…
-
hyh
medium
# Balancer rebalance operation is permanently blocked whenever owner assigns `rebalancer` role to some other address
## Summary
Balancer's `rebalance()` controls access rights by reques…
-
### Community Note
* Please vote on this issue by adding a 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to the original issue to help the…
ghost updated
2 years ago
-
### Community Note
* Please vote on this issue by adding a 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to the original issue to help the…
-
Hello. First of all, thank you for this amazing framework, it looks incredible!
I would like to ask how to integrate SNI SSL support for multiple domains without having to launch several servers a…
-
We need to investigate and define what it would take to add rate limiting to the dotAI APIs. There are sure to be patterns we can use for this; we need to figure out which one(s) would make the most …
-
### Community Note
* Please vote on this issue by adding a 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to the original issue to help the…
-
There was a request at OWASP conference to support stateless architecture where servers could be behind a load balancer.
In such case a common session storage might not be available; There could b…
-
hey how about using KEY for API to make it more secure to access?
Zxce3 updated
5 months ago