Tweaking overload settings in gateway api?

envoyproxy / gateway

Manages Envoy Proxy as a Standalone or Kubernetes-based Application Gateway

https://gateway.envoyproxy.io

Apache License 2.0

1.45k stars 297 forks source link

Tweaking overload settings in gateway api? #3604

Open nezdolik opened 3 weeks ago

nezdolik commented 3 weeks ago

Description: Since overload manager config is not part of Envoy gateway api and cannot be patched via Envoy patch policy, how could one tweak values for global max downstream connections (except of having to provide custom bootstrap config)?

[optional Relevant Links:]

Any extra documentation required to understand the issue.

arkodg commented 3 weeks ago

its currently set to 50K https://github.com/envoyproxy/gateway/pull/3082, any alternate values in mind ? hoping we we pick a sane default here, and we can provide an API field in https://gateway.envoyproxy.io/v1.0.1/api/extension_types/#envoyproxy to support modifying it for edge cases

nezdolik commented 3 weeks ago

@arkodg 50k is good default value, but the actual value very much depends on prod features enabled in the proxy. E.g. at my previous workplace Envoy instance performance was 10x times lower compared to official benchmarks due to custom Java sidecar for ext authz.