fluent / helm-charts

Helm Charts for Fluentd and Fluent Bit
Apache License 2.0
386 stars 460 forks source link

Error in the fluentd pod #540

Open masoodamunchen opened 3 months ago

masoodamunchen commented 3 months ago

Helllo, I have a fluend daemonset deployment with your chart but i am getting this warning message in the pod and this causes a crash, could you please check what could be it? Any help is highly appreciated

ailed to flush the buffer. retry_times=0 next_retry_time=2024-08-07 23:12:16 +0000 chunk="61f20090e1c9331f4ac0a93f878658be" error_class=Fluent::Plugin::ElasticsearchOutput::RecoverableRequestFailure error="could not push logs to Elasticsearch cluster ({:host=>\"xxxx.fluentd.svc.cluster.local\", :port=>9200, :scheme=>\"http\", :user=>\"xxxxx\", :password=>\"obfuscated\", :path=>\"\"}): [400] {\"error\":{\"root_cause\":[{\"type\":\"illegal_argument_exception\",\"reason\":\"Action/metadata line [1] contains an unknown parameter [_type]\"}],\"type\":\"illegal_argument_exception\",\"reason\":\"Action/metadata line [1] contains an unknown parameter [_type]\"},\"status\":400}"

dioguerra commented 3 months ago

Could you please provide configuration parameters?

masoodamunchen commented 3 months ago

@dioguerra : Thanks for your reply. I am using argocd manifest for the deployment and this is what i am passing from argocd manifest (check from the helm: part) . So it takes the overridden value (i can see in the livemanifest and logs) and it targets the right elastic host (with overridden value) but when the daemonset pods tries to put the log into elastic it falls into the original error message for which i created this issue. targetRevision: {{ index .Values "fluentd" "targetRevision" }} repoURL: {{ index .Values "fluentd" "repoURL" }} chart: {{ index .Values "fluentd" "chart" }} helm: valuesObject: fileConfigs: 04_outputs.conf: |- <label @OUTPUT> <match **> @type elasticsearch host "xxxx-yyyy-zzzz" port 9200 path "" user "elastic" password "changeme" verify_es_version_at_startup false And the values.yaml contains something like this fluentd: enabled: true autosyncEnabled: false targetRevision: 0.4.3 repoURL: "https://fluent.github.io/helm-charts" chart: fluentd volumeMounts:

masoodamunchen commented 2 months ago

@dioguerra : I have provided the configuration parameters above, any suggestions? as I can understood from the issue it doesn't like @type elasticsearch but i think when I am trying to override i have to provide the whole config set from my manifest.