n-j-91
commented
5 years ago I think I found where the issue was. Modified following in https://github.com/uchann2/fluent-plugin-beats/blob/master/lib/lumberjack/beats/server.rb and it seems to do the trick.
Added more error handling for,
Errno::EAGAIN,
Errno::EBADF,
Errno::EACCES,
IO::EAGAINWaitReadable rescue EOFError,
OpenSSL::SSL::SSLError,
IOError,
Errno::ECONNRESET,
Errno::EPIPE,
Errno::EAGAIN,
Errno::EBADF,
Errno::EACCES,
IO::EAGAINWaitReadable
# EOF or other read errors, only action is to shutdown which we'll do in
# 'ensure'
rescue
I have multiple filebeat instances to send logs to td agent. Once i enable fluent-plugin-beats with following configuration, i observe a unexpected error error="Resource temporarily unavailable" in td-agent log. ruby process goes to 100% CPU utilization and i see huge number of CLOSE_WAIT connections piling up on fluentd server.
I am using fluent-plugin-beats (1.0.0) on fluentd (1.2.2)
Here is my td-agent config, and flilebeat configs;