search

gtrevg / fluent-plugin-splunk-ex

A fluentd plugin that can push data to splunk in either key=value or JSON format. Also supports reconnects on broken connections.
11 stars 9 forks source link

td-agent 'encode' warning #3

Open ThreatHunterDiary opened 7 years ago

ThreatHunterDiary commented 7 years ago

Hi Team,

I am getting an error in sending data from td-agent to splunk..

Though I am receiving data on splunk end, I believe some of the data are getting dropped because of the error, and I am not sure what's causing the error!

Error:

[warn]: suppressed same stacktrace
[warn]: record_reformer: Encoding::UndefinedConversionError "\xEF" from ASCII-8BIT to UTF-8 /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluent-plugin-splunk-ex-1.0.2/lib/fluent/plugin/out_splunk_ex.rb:83:in `encode'
[warn]: emit transaction failed: error_class=Encoding::UndefinedConversionError error="\"\\xEF\" from ASCII-8BIT to UTF-8" tag="XYZ"
gtrevg commented 7 years ago

@jet1276 Hmm... I'll have to see what may be causing this. I'll have to write some unit tests that test out UTF-8 characters to see how it affects the system. There may be some sort of encoding setting that I have to set. If that doesn't work, I'll have to catch the error and see if it can get encoded in a different fashion.

ThreatHunterDiary commented 6 years ago

Hi @gtrevg,

Any update on this one??

I'm still getting the error time to time.

fuxes commented 5 years ago

@jet1276 @gtrevg Have you found a workaround or a fix for this issue?