tagomoris / fluent-plugin-secure-forward

Other
140 stars 30 forks source link

MessagePack::UnknownExtTypeError, there is not time_as_integer to set #66

Closed abhiTamrakar closed 6 years ago

abhiTamrakar commented 6 years ago

@tagomoris we are hitting error_class=MessagePack::UnknownExtTypeError error="unexpected extension type in secure forward plugin and due to this our setup is breaking, buffer overflow is even because fluentd is not able to flush the buffer. I see this error in the receiving end(aggregator side). I tried putting time_as_integer true but as expected its not in the code so has not affect. Please help.

history: we haven't had this issue before but only after we got 'invalid byte in UTF8' error and we tried to fix that, we saw this error.

Information below: Logs at aggregator:

'''

2018-03-27 05:54:28 +0000 [error]: #0 failed to emit fluentd's log event tag="fluent.warn" event={"error_class"=>"Fluent::Plugin::Buffer::BufferOverflowError", "error"=>"#", "message"=>"unexpected error in in_secure_forward from x.x.x.x:2067 error_class=Fluent::Plugin::Buffer::BufferOverflowError error=#"} error_class=Fluent::Plugin::Buffer::BufferOverflowError error="buffer space has too many data" 2018-03-27 05:54:34 +0000 [warn]: #0 emit transaction failed: error_class=MessagePack::UnknownExtTypeError error="unexpected extension type" location="/opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-1.1.2/lib/fluent/event.rb:237:in feed_each'" tag="" 2018-03-27 05:54:34 +0000 [warn]: #0 unexpected error in in_secure_forward from x.x.x.x:2003 error_class=MessagePack::UnknownExtTypeError error=#<MessagePack::UnknownExtTypeError: unexpected extension type> 2018-03-27 05:54:34 +0000 [error]: #0 failed to emit fluentd's log event tag="fluent.warn" event={"error"=>"#<MessagePack::UnknownExtTypeError: unexpected extension type>", "location"=>"/opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-1.1.2/lib/fluent/event.rb:237:infeed_each'", "tag"=>"", "message"=>"emit transaction failed: error_class=MessagePack::UnknownExtTypeError error=\"unexpected extension type\" location=\"/opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-1.1.2/lib/fluent/event.rb:237:in `feed_each'\" tag=\"\""} error_class=Fluent::Plugin::Buffer::BufferOverflowError error="buffer space has too many data" 2018-03-27 05:54:34 +0000 [error]: #0 failed to emit fluentd's log event tag="fluent.warn" event={"error_class"=>"MessagePack::UnknownExtTypeError", "error"=>"#", "message"=>"unexpected error in in_secure_forward from x.x.x.x:2003 error_class=MessagePack::UnknownExtTypeError error=#"} error_class=Fluent::Plugin::Buffer::BufferOverflowError error="buffer space has too many data" 2018-03-27 05:54:37 +0000 [warn]: #0 unexpected error in in_secure_forward from x.x.x.x:2068 error_class=Fluent::Plugin::Buffer::BufferOverflowError error=# 2018-03-27 05:54:37 +0000 [error]: #0 failed to emit fluentd's log event tag="fluent.warn" event={"error_class"=>"Fluent::Plugin::Buffer::BufferOverflowError", "error"=>"#", "message"=>"unexpected error in in_secure_forward from x.x.x.x:2068 error_class=Fluent::Plugin::Buffer::BufferOverflowError error=#"} error_class=Fluent::Plugin::Buffer::BufferOverflowError error="buffer space has too many data" ''' Forwarder config: Running inside docker conatiner version: /usr/local/bin/fluentd --version fluentd 1.1.2

Aggregator config: version: $ /usr/sbin/td-agent --version td-agent 1.1.2

Attached conf files, let me know if you need more details. aggregator_conf.txt forwarder_conf.txt

tagomoris commented 6 years ago

You're using this plugin on Fluentd v1, but it's not supported. Use tls support feature of Fluentd v1 forward plugin, instead of using this plugin.