uken / fluent-plugin-elasticsearch

Apache License 2.0
891 stars 310 forks source link

DNS reslove error #940

Open yphanikumar1995 opened 2 years ago

yphanikumar1995 commented 2 years ago

(check apply)

Problem

... We are getting below error no address for cl-es-master.commonservices.svc.cluster.local (Resolv::ResolvError)"

If we exec into kubernetes pod and do the nslookup or dig it is resloving the ip address

Can you give the solution and let me know why this error coming

Steps to replicate

Either clone and modify https://gist.github.com/pitr/9a518e840db58f435911

OR

Provide example config and message

Expected Behavior or What you need to ask

...

Using Fluentd and ES plugin versions

joelsdc commented 2 years ago

Did you ever figure out what causes this? I'm seeing the same issue...

eli-gc commented 1 year ago

Running into the same error. Seems to resolve if we restart fluentd pod, but I'm guessing it happens again over time.

vishalk663 commented 1 year ago

Hi We are also facing the same issue repeatedly. Our EFK cluster is deployed in kubernetes cluster. we are getting the (Resolv::ResolvError) when connecting to elasticsearch service. because of this issue we lost some chunks which was not pushed into elasticsearch.

we are using file buffer with below configuration.

      <buffer>
        @type file
        path /var/log/xxxx/xxxx/
        total_limit_size 64GB
        chunk_limit_size 8MB
        flush_mode interval
        flush_interval 5s
        flush_thread_count 8
        retry_type exponential_backoff
        retry_timeout 6h
        retry_max_interval 30

Thanks

vishalk663 commented 1 year ago

Can someone please help here?