search

fabric8io / fluent-plugin-kubernetes_metadata_filter

Enrich your fluentd events with Kubernetes metadata
Apache License 2.0
350 stars 166 forks source link

Connection Reset By Peer #380

Closed glend17 closed 4 months ago

glend17 commented 4 months ago

I am using a daemonset and every time one pod is running healthy while the other one keeps going into restarts every 5 minutes

/usr/local/lib/ruby/2.6.0/openssl/buffering.rb:125:in `sysread': Connection reset by peer (Errno::ECONNRESET)
    from /usr/local/lib/ruby/2.6.0/openssl/buffering.rb:125:in `readpartial'
    from /usr/local/bundle/gems/http-0.9.8/lib/http/timeout/null.rb:41:in `readpartial'
    from /usr/local/bundle/gems/http-0.9.8/lib/http/connection.rb:210:in `read_more'
    from /usr/local/bundle/gems/http-0.9.8/lib/http/connection.rb:80:in `readpartial'
    from /usr/local/bundle/gems/http-0.9.8/lib/http/response/body.rb:21:in `readpartial'
    from /usr/local/bundle/gems/http-0.9.8/lib/http/response/body.rb:26:in `each'
    from /usr/local/bundle/gems/kubeclient-1.1.4/lib/kubeclient/watch_stream.rb:24:in `each'
    from /usr/local/bundle/gems/fluent-plugin-kubernetes_metadata_filter-0.27.0/lib/fluent/plugin/filter_kubernetes_metadata.rb:386:in `start_watch'
    from /usr/local/bundle/gems/fluent-plugin-kubernetes_metadata_filter-0.27.0/lib/fluent/plugin/filter_kubernetes_metadata.rb:200:in `block in configure'
Unexpected error Connection reset by peer
  /usr/local/lib/ruby/2.6.0/openssl/buffering.rb:125:in `sysread'
  /usr/local/lib/ruby/2.6.0/openssl/buffering.rb:125:in `readpartial'
  /usr/local/bundle/gems/http-0.9.8/lib/http/timeout/null.rb:41:in `readpartial'
  /usr/local/bundle/gems/http-0.9.8/lib/http/connection.rb:210:in `read_more'
  /usr/local/bundle/gems/http-0.9.8/lib/http/connection.rb:80:in `readpartial'
  /usr/local/bundle/gems/http-0.9.8/lib/http/response/body.rb:21:in `readpartial'
  /usr/local/bundle/gems/http-0.9.8/lib/http/response/body.rb:26:in `each'
  /usr/local/bundle/gems/kubeclient-1.1.4/lib/kubeclient/watch_stream.rb:24:in `each'
  /usr/local/bundle/gems/fluent-plugin-kubernetes_metadata_filter-0.27.0/lib/fluent/plugin/filter_kubernetes_metadata.rb:386:in `start_watch'
  /usr/local/bundle/gems/fluent-plugin-kubernetes_metadata_filter-0.27.0/lib/fluent/plugin/filter_kubernetes_metadata.rb:200:in `block in configure'

It fixes itself some times when doing rollout restart

jcantrill commented 4 months ago

Unexpected error Connection reset by peer

This typically is an issue unrelated to the library but something happening with the server. There is nothing in this exception trace that would provide enough information to provide additional diagnostics.