vmware / fluent-plugin-vmware-loginsight

Fluentd plugin to forward logs to VMware Aria Operations for Logs
Other
10 stars 13 forks source link

Contribute buffered mode of operation for out_vmware_loginsight #15

Closed shadjiiski closed 1 year ago

shadjiiski commented 4 years ago

This:

With buffered mode available, one can make use of the built-in retry backoff functionality when a request to vRLI fails. Furthermore, it allows for seamlessly batching requests regardless of whether events were emitted one by one or in bunches. It also allows to offload the queue of events to the hard drive, to specify size limits for the buffer and an overflow policy.

Up to date plugin development reference with different operating modes explained: https://docs.fluentd.org/plugin-development/api-plugin-output More on the buffer configuration: https://docs.fluentd.org/configuration/buffer-section

mohitevishal commented 1 year ago

Hi @shadjiiski Buffer support was added sometime ago, so I'll close this request. Nevertheless, plugin's original method supported batching which acts like an mem-buffer and can be performant if you increase the batch size.