Open wexgjduv opened 3 years ago
After inspecting the file contents in running pod's log file, some logs had wrong encoding like \u0008˵\ufffd
or \ufffd<90>\ufffd\u
or \ufffdʁ\ufffd\
. I disabled outputting of these logs, other logs were collected by our plugin successfully.
I think the encoding of the pod's log may affect the collectiong of other logs.
I have fluent-bit deployed in k8s with the go plugin, but we noticed some specific logs are lost.
Here is the pod's log:
{"level":"debug","ts":1625627314150.1467,"caller":"xservice/callback.go:179","msg":"api call done","app":"test","appBuildHost":"runner-x","appBuildTime":"2021-07-06 10:14:06","appGoVersion":"go1.15","appGitTag":"v0.6.0_2021-07-06_10-14-06","appGitVersion":"30333326","Resp":"task_id:1628888882647513000 data:{x_id:6108888888888787 xList:{rn:\"rn:xt:x/64888888889070\" timestamp:{seconds:1625627313 nanos:21238000} x_id:2020092191 status:FINISHED amount:{amount:1} x_list:{amount:{amount:1} x:{rn:\"rn:xx:y/59578888888885733\" x_owner:{user_rn:\"rn:user:legacy-user/1688850\" xx_qq_rn:\"rn:xx:xx/58033951876352146:qq/59600811175680000\" display_name:{language:\"zh-CN\" text:\"张\"}} type:EXTERNAL display_name:{language:\"zh-CN\" text:\"测试 Mall\"}} external_xx_info:\"{\\"Data\\":{\\"XInCent\\":1,\\"CreateTime\\":1625627313,\\"Cent\\":1,\\"ETime\\":1625627313,\\"ErrorCode\\":null,\\"ErrorDescription\\":null,\\"Status\\":\\"Success\\"},\\"ID\\":\\"73b7cb2ad93f\\",\\"NotifyTime\\":1625627313,\\"NotifyType\\":\\"XResult\\",\\"XServiceID\\":1712788888888888889,\\"XNumber\\":46766078888888888875}\"}}}","x-trace-id":"da488888888888758893429","x-span-id":"7188888888833","x-parent-id":"388888888886"}
In
FLBPluginFlushCtx
, I tried to print all records but found no messages likeapi call done
in fluent-bit's output.