@tagomoris we are hitting error_class=MessagePack::UnknownExtTypeError error="unexpected extension type in secure forward plugin and due to this our setup is breaking, buffer overflow is even because fluentd is not able to flush the buffer. I see this error in the receiving end(aggregator side).
I tried putting time_as_integer true but as expected its not in the code so has not affect.
Please help.
history: we haven't had this issue before but only after we got 'invalid byte in UTF8' error and we tried to fix that, we saw this error.
Information below:
Logs at aggregator:
'''
2018-03-27 05:54:28 +0000 [error]: #0 failed to emit fluentd's log event tag="fluent.warn" event={"error_class"=>"Fluent::Plugin::Buffer::BufferOverflowError", "error"=>"#", "message"=>"unexpected error in in_secure_forward from x.x.x.x:2067 error_class=Fluent::Plugin::Buffer::BufferOverflowError error=#"} error_class=Fluent::Plugin::Buffer::BufferOverflowError error="buffer space has too many data"
2018-03-27 05:54:34 +0000 [warn]: #0 emit transaction failed: error_class=MessagePack::UnknownExtTypeError error="unexpected extension type" location="/opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-1.1.2/lib/fluent/event.rb:237:in feed_each'" tag="" 2018-03-27 05:54:34 +0000 [warn]: #0 unexpected error in in_secure_forward from x.x.x.x:2003 error_class=MessagePack::UnknownExtTypeError error=#<MessagePack::UnknownExtTypeError: unexpected extension type> 2018-03-27 05:54:34 +0000 [error]: #0 failed to emit fluentd's log event tag="fluent.warn" event={"error"=>"#<MessagePack::UnknownExtTypeError: unexpected extension type>", "location"=>"/opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-1.1.2/lib/fluent/event.rb:237:infeed_each'", "tag"=>"", "message"=>"emit transaction failed: error_class=MessagePack::UnknownExtTypeError error=\"unexpected extension type\" location=\"/opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-1.1.2/lib/fluent/event.rb:237:in `feed_each'\" tag=\"\""} error_class=Fluent::Plugin::Buffer::BufferOverflowError error="buffer space has too many data"
2018-03-27 05:54:34 +0000 [error]: #0 failed to emit fluentd's log event tag="fluent.warn" event={"error_class"=>"MessagePack::UnknownExtTypeError", "error"=>"#", "message"=>"unexpected error in in_secure_forward from x.x.x.x:2003 error_class=MessagePack::UnknownExtTypeError error=#"} error_class=Fluent::Plugin::Buffer::BufferOverflowError error="buffer space has too many data"
2018-03-27 05:54:37 +0000 [warn]: #0 unexpected error in in_secure_forward from x.x.x.x:2068 error_class=Fluent::Plugin::Buffer::BufferOverflowError error=#
2018-03-27 05:54:37 +0000 [error]: #0 failed to emit fluentd's log event tag="fluent.warn" event={"error_class"=>"Fluent::Plugin::Buffer::BufferOverflowError", "error"=>"#", "message"=>"unexpected error in in_secure_forward from x.x.x.x:2068 error_class=Fluent::Plugin::Buffer::BufferOverflowError error=#"} error_class=Fluent::Plugin::Buffer::BufferOverflowError error="buffer space has too many data"
'''
Forwarder config: Running inside docker conatiner
version: /usr/local/bin/fluentd --version
fluentd 1.1.2
@tagomoris we are hitting error_class=MessagePack::UnknownExtTypeError error="unexpected extension type in secure forward plugin and due to this our setup is breaking, buffer overflow is even because fluentd is not able to flush the buffer. I see this error in the receiving end(aggregator side). I tried putting time_as_integer true but as expected its not in the code so has not affect. Please help.
history: we haven't had this issue before but only after we got 'invalid byte in UTF8' error and we tried to fix that, we saw this error.
Information below: Logs at aggregator:
'''
2018-03-27 05:54:28 +0000 [error]: #0 failed to emit fluentd's log event tag="fluent.warn" event={"error_class"=>"Fluent::Plugin::Buffer::BufferOverflowError", "error"=>"#", "message"=>"unexpected error in in_secure_forward from x.x.x.x:2067 error_class=Fluent::Plugin::Buffer::BufferOverflowError error=#"} error_class=Fluent::Plugin::Buffer::BufferOverflowError error="buffer space has too many data"
2018-03-27 05:54:34 +0000 [warn]: #0 emit transaction failed: error_class=MessagePack::UnknownExtTypeError error="unexpected extension type" location="/opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-1.1.2/lib/fluent/event.rb:237:in ", "message"=>"unexpected error in in_secure_forward from x.x.x.x:2003 error_class=MessagePack::UnknownExtTypeError error=#"} error_class=Fluent::Plugin::Buffer::BufferOverflowError error="buffer space has too many data"
2018-03-27 05:54:37 +0000 [warn]: #0 unexpected error in in_secure_forward from x.x.x.x:2068 error_class=Fluent::Plugin::Buffer::BufferOverflowError error=#
2018-03-27 05:54:37 +0000 [error]: #0 failed to emit fluentd's log event tag="fluent.warn" event={"error_class"=>"Fluent::Plugin::Buffer::BufferOverflowError", "error"=>"#", "message"=>"unexpected error in in_secure_forward from x.x.x.x:2068 error_class=Fluent::Plugin::Buffer::BufferOverflowError error=#"} error_class=Fluent::Plugin::Buffer::BufferOverflowError error="buffer space has too many data"
'''
Forwarder config: Running inside docker conatiner
version: /usr/local/bin/fluentd --version
fluentd 1.1.2
feed_each'" tag="" 2018-03-27 05:54:34 +0000 [warn]: #0 unexpected error in in_secure_forward from x.x.x.x:2003 error_class=MessagePack::UnknownExtTypeError error=#<MessagePack::UnknownExtTypeError: unexpected extension type> 2018-03-27 05:54:34 +0000 [error]: #0 failed to emit fluentd's log event tag="fluent.warn" event={"error"=>"#<MessagePack::UnknownExtTypeError: unexpected extension type>", "location"=>"/opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-1.1.2/lib/fluent/event.rb:237:in
feed_each'", "tag"=>"", "message"=>"emit transaction failed: error_class=MessagePack::UnknownExtTypeError error=\"unexpected extension type\" location=\"/opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-1.1.2/lib/fluent/event.rb:237:in `feed_each'\" tag=\"\""} error_class=Fluent::Plugin::Buffer::BufferOverflowError error="buffer space has too many data" 2018-03-27 05:54:34 +0000 [error]: #0 failed to emit fluentd's log event tag="fluent.warn" event={"error_class"=>"MessagePack::UnknownExtTypeError", "error"=>"#Aggregator config: version: $ /usr/sbin/td-agent --version td-agent 1.1.2
Attached conf files, let me know if you need more details. aggregator_conf.txt forwarder_conf.txt