search

fluent / fluent-operator

Operate Fluent Bit and Fluentd in the Kubernetes way - Previously known as FluentBit Operator
Apache License 2.0
577 stars 246 forks source link

Feature/additional elasticsearch options #1220

Closed bakervos closed 3 months ago

bakervos commented 3 months ago

What this PR does / why we need it:

This PR adds a couple of options to the out_elasticsearch and out_elasticsearch_data_stream fluentd plugins. It implements the options in #1210 and then some more.

I needed to update controller-gen to a newer version as v0.11.3 did not support go 1.22.

Which issue(s) this PR fixes:

Fixes #1210

Does this PR introduced a user-facing change?

Added options for ILM to fluentd out_elasticsearch and out_elasticsearch_data_stream plugin
Added options for datastream templates to fluentd out_elasticsearch_data_stream plugin
Added option for logging the ES 400 reason without enabling logLevel: debug to fluentd out_elasticsearch plugin
Added options for managing connections (e.g. reload, reconnect on error) to elasticsearch in fluentd plugin
Added options to allow always updating an elasticsearch template to fluentd out_elasticsearch plugin

Additional documentation, usage docs, etc.:

benjaminhuo commented 3 months ago

That's great, thank you! @bakervos