logstash-plugins / logstash-output-lumberjack

Apache License 2.0
6 stars 25 forks source link

Implement Round Robin/Load balancing #23

Open ph opened 8 years ago

ph commented 8 years ago

On the first payload of events, the plugin will randomly choose a server and will keep that connection open until something bad happen to the server. It would be great if we had the option to round robin between sending batches.

ph commented 8 years ago

cc @jakommo

lsoumille commented 6 years ago

Any progress on this ?

GazzaC commented 6 years ago

I would like to hear news on this item also. I have a tiered implementation of logstash which is connected via the lumberjack protocol and the logstash-output-lumberjack and logstash-input-lumberjack plugins. I also employ the logstash multi pipeline feature and connect multi-piplines vua lumberjack on a 2 tiered arrangement. Are there any plans on this happening soon?

ydewinte commented 4 years ago

Any update?

systemdave commented 4 years ago

Has there been any further discussion on a path forward for this functionality Logstash to Logstash?

tomerilp commented 4 years ago

any chance to add this capability?

tfrederick74656 commented 3 years ago

I am also very interested in this functionality. Working with an implementation ow that consists of larger individual Logstash nodes at various remote sites that aggregate to a scale-out set of lower-spec cloud-hosted Logstash nodes. It's impossible to achieve horizontal scalability at the final aggregation point when the downstream nodes use sticky node selection and may be larger than any individual node in the upstream set.

nextsummer33 commented 3 years ago

Just checking the code in lumberjack client, A host is selected by shuffling the array and pop the last. As the result, it just create a single connection rather than multiple connections and flush the data to each host by the round robin.