Closed wendorf closed 6 years ago
Dan,
Which application or platform logs are you trying to upload to Scalyr? Are you trying to load Kubernetes metadata?
Regards, Anup
This problem was caused by something missed during the upgrade from 0.12 -> 1.0, and I've just pushed a commit (debc460c9eb) that should fix the issue and bumped the version number to 0.8.4.
@imron Thanks! I'll check out the new version and report back.
@anup3000 Yes, I'm loading Kubernetes metadata on Kubernetes 1.9.6
You'll likely still get a warning because the issue appears to have been triggered by invalid utf-8, but the handling of that UndefinedConversionError will no longer have errors and the plugin will log the event with any invalid utf replaced with <?>
@imron I just tried to test, but the updated gem hasn't been published to RubyGems? Can you publish it? Thanks!
@wendorf We will work on publishing the gem and let you know when it is available. - Thanks
Looks great! I'm now getting the more-expected:
2018-04-19 22:35:05 +0000 [warn]: #0 Encoding::UndefinedConversionError: "\xC2" from ASCII-8BIT to UTF-8
2018-04-19 22:35:05 +0000 [warn]: #0 dump an error event: error_class=Encoding::UndefinedConversionError error="\"\\xC2\" from ASCII-8BIT to UTF-8" location="/opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluent-plugin-scalyr-0.8.4/lib/fluent/plugin/out_scalyr.rb:321:in `encode'" tag="kube-apiserver" time=#<Fluent::EventTime:0x007f27e277c048 @sec=1524177292, @nsec=443552000> record={"severity"=>"I", "time"=>"0419 22:34:52.443552", "pid"=>"1", "source"=>"wrap.go:42", "message"=>"GET /api/v1/namespaces/kube-system/endpoints/kube-scheduler: (795.938\xC2\xB5s) 200 [[kube-scheduler/v1.9.6 (linux/amd64) kubernetes/9f8ebd1/leader-election] 127.0.0.1:58672]", "logfile"=>"/fluentd/kube-apiserver"}
Thanks for the rapid response on this!
Hi Dan,
We have uploaded new gem. Please let us know how it goes.
Regards, Anup
I'm using fluent-plugin-scalyr 0.8.3 with fluentd 1.1.0 and am seeing errors in the fluentd logs that I believe correspond with a lack of logs getting emitted to Scalyr: