fluent / helm-charts

Helm Charts for Fluentd and Fluent Bit
Apache License 2.0
374 stars 443 forks source link

Error in the fluentd pod #540

Open masoodamunchen opened 1 month ago

masoodamunchen commented 1 month ago

Helllo, I have a fluend daemonset deployment with your chart but i am getting this warning message in the pod and this causes a crash, could you please check what could be it? Any help is highly appreciated

ailed to flush the buffer. retry_times=0 next_retry_time=2024-08-07 23:12:16 +0000 chunk="61f20090e1c9331f4ac0a93f878658be" error_class=Fluent::Plugin::ElasticsearchOutput::RecoverableRequestFailure error="could not push logs to Elasticsearch cluster ({:host=>\"xxxx.fluentd.svc.cluster.local\", :port=>9200, :scheme=>\"http\", :user=>\"xxxxx\", :password=>\"obfuscated\", :path=>\"\"}): [400] {\"error\":{\"root_cause\":[{\"type\":\"illegal_argument_exception\",\"reason\":\"Action/metadata line [1] contains an unknown parameter [_type]\"}],\"type\":\"illegal_argument_exception\",\"reason\":\"Action/metadata line [1] contains an unknown parameter [_type]\"},\"status\":400}"

dioguerra commented 1 month ago

Could you please provide configuration parameters?

masoodamunchen commented 1 month ago

@dioguerra : Thanks for your reply. I am using argocd manifest for the deployment and this is what i am passing from argocd manifest (check from the helm: part) . So it takes the overridden value (i can see in the livemanifest and logs) and it targets the right elastic host (with overridden value) but when the daemonset pods tries to put the log into elastic it falls into the original error message for which i created this issue. targetRevision: {{ index .Values "fluentd" "targetRevision" }} repoURL: {{ index .Values "fluentd" "repoURL" }} chart: {{ index .Values "fluentd" "chart" }} helm: valuesObject: fileConfigs: 04_outputs.conf: |- <label @OUTPUT> <match **> @type elasticsearch host "xxxx-yyyy-zzzz" port 9200 path "" user "elastic" password "changeme" verify_es_version_at_startup false And the values.yaml contains something like this fluentd: enabled: true autosyncEnabled: false targetRevision: 0.4.3 repoURL: "https://fluent.github.io/helm-charts" chart: fluentd volumeMounts:

masoodamunchen commented 2 weeks ago

@dioguerra : I have provided the configuration parameters above, any suggestions? as I can understood from the issue it doesn't like @type elasticsearch but i think when I am trying to override i have to provide the whole config set from my manifest.