-
right now it just uses `random.choices`, refer to my comment here: https://github.com/open-webui/open-webui/blob/8ed5759d0e9424f87d01fe3f8013116c4ba2004f/backend/apps/ollama/main.py#L39
tjbck updated
2 weeks ago
-
Lets say I have many request coming to the venom bot, does load balancing or going serveless is going to help me manage concurrent bulk request?
-
Hallo Zusammen,
Ich habe einen Vorschlag für einen (möglichen) zusätzlichen Use Case:
Der Fronius WattPilot dürfte die AC-Ströme die vom SmartMeter übermittelt werden für das Load Balancing verw…
-
Can I export the traffic to two elasticsearches, both of which need complete flow without load balancing.
-
It would be nice to have a _real_ load balancing strategy which chooses coordinators based on actual metrics such as how fast it can process requests.
See https://github.com/scylladb/scylla/issues/…
-
I found an issue with this document.
Title: Load Balancing
Location: https://fly.io/docs/reference/load-balancing/
Source: https://github.com/superfly/docs/blob/main/reference/load-balancing.html…
-
Hello! I have been using this docker for a while now. It is truly great. There could be two native integrations that should be relatively straightforward. NGINX supports load balancing to servers nati…
-
Good day..
i am new using the NPM, how can i config the load balancing here in NPM is it in the advance tab? or custom location?
and how can i achieve this??? is there any sample file so i can f…
-
As per the supported load balancing strategies in the [initial design](https://github.com/AbsaOSS/ohmyglb/blob/master/docs/index.md#load-balancing-strategies) a _manual_ strategy should be implemented…
-
Hello FreeRDP Team,
I want to use the load balancing feature in the freeRDP Android Client.
Can anyone tell me, how i can pass the values to the load balancing in the Android FreeRDP app.
Plea…