-
### Motivation.
The Fastchat-vLLM operational model offers significant advantages in deploying large language models (LLMs) for product services. [1](https://blog.vllm.ai/2023/06/20/vllm.html)
T…
-
##### SUMMARY
I want to update the "load balancing rules" of a basic Azure Load Balancer.
In Ansible 2.8, that module was updated for idempotency and it can be used to updated an existing LB object.…
-
# istio
- control traffic between services with dynamic route configuration
- conduct A/B tests
- release canaries
- gradually upgrade versions using red/black deployments
- apply organizatio…
-
AS a gamer,
I WANT TO have my money separated from my health
SO THAT don't die so easily just after spend big money.
This game has a big skill requirement that is not friendly to first-timers.
Reas…
-
**Problem description (if applicable)**
As a deployment engineer, I should be able to use airshipctl to deploy a multi-node HA K8s cluster and host the control plane API on a dedicated but optional l…
-
**What would you like to be added**:
Extend the *loadbalance* plugin with a new "weighted-round-robin" strategy.
**Why is this needed**:
The *loadbalance* plugin only provides a random sh…
-
Service mesh use SideCar design partten, I think Service Fabric Reserve Porxy is a implement of SideCar design partten, is it suitable?
Is Service Fabric totally fulfilled implement Service Mesh?
…
-
The current spire-agent resolver and load balancer are configured to be DNS with round robin load balancing. gRPC implements that round robin as connecting to each address that the resolver presents a…
-
It would be great if a Top-Up valve could be added, similar to the mod Flow Control, which has a non-return, a top-up and an overflow valve.
A top-up valve only allows fluid to flow if the output(wha…
-
Hello there 👋🏽,
Thanks for making this awesome tool.
I would like to get some perspective on how the operator scales or how it can be scaled to handle 1k+ HTTP checks (at a 30-second interval or 1…