lyft / clutch

Extensible platform for infrastructure management
https://clutch.sh
Apache License 2.0
1.7k stars 119 forks source link

chaos_experimentation: squeeze experiments #1369

Open kathan24 opened 3 years ago

kathan24 commented 3 years ago

Description When we perform a Squeeze experiment on service, we route additional traffic to a particular host in that service. This helps in determining the maximum number of concurrent requests that can be served by that host in a cluster. After performing the squeeze experiment, one can set the scaling threshold of service as well as the circuit breaking threshold.

To route additional traffic to a host, load balancing needs to be adjusted in a way that the host under experiment gets more weight. This can be achieved with Envoy Proxy's load balancing policies

Complexity [S/M/L]: L

AARonSTeneo commented 4 months ago

There is another of achieving this outcome by potentially injecting consecutive waves of latency. I built something recently to do this if you have any interest in chatting. Looks like this is no longer an active project but ping me at aaron@sce.dev if you're interested. The plan is to open source it later this year but id also like to learn more about what lyft is doing with this project.