Currently it seems like the load balancer for bedrock prod has an rps set at 100 per node. This might be artificially scaling up the number of nodes in our cluster (which is to say, bedrock pods as deployed could handle more load, but that setting spins up more nodes).
Let's figure out what that setting does, and pick a value for it that makes sense.
Currently it seems like the load balancer for bedrock prod has an rps set at 100 per node. This might be artificially scaling up the number of nodes in our cluster (which is to say, bedrock pods as deployed could handle more load, but that setting spins up more nodes).
Let's figure out what that setting does, and pick a value for it that makes sense.