Azure / logstash-output-kusto

Logstash output for Kusto
Apache License 2.0
13 stars 14 forks source link

upload_concurrent_count optimal setting #68

Closed sfennell closed 3 months ago

sfennell commented 10 months ago

While reading over https://github.com/Azure/logstash-output-kusto/issues/46, I noticed the addition of the upload_concurrent_count setting. This seems to default to 2, whereas it was previously defaulted to 8. Is there an optimal value for this setting?

I'm running multiple Logstash servers with load balancer splitting the traffic to Logstash server pairs for firewall events. This seems ok, as long as, both servers are ok, however, from time to time, something causes one of the servers to use up all available FDs at the OS level. This issue seems to start within the upload process and retires.