search

fluent / fluent-bit

Fast and Lightweight Logs and Metrics processor for Linux, BSD, OSX and Windows
https://fluentbit.io
Apache License 2.0
5.89k stars 1.59k forks source link

fluent-bit http output plugin generating many logs when output is connected #6109

Closed nikhithakarennagari closed 1 year ago

nikhithakarennagari commented 2 years ago

Bug Report

Describe the bug Fluentbit http output plugin is generating many logs when connection is established with the output host.

{"timestamp":"2022-09-27T05:23:12.208+00:00","severity":"info","message":"[output:http:] :port, HTTP status=200"} {"timestamp":"2022-09-27T05:23:12.221+00:00","severity":"info","message":"[output:http:] :port, HTTP status=200"} {"timestamp":"2022-09-27T05:23:15.245+00:00","severity":"info","message":"[output:http:] :port, HTTP status=200"} {"timestamp":"2022-09-27T05:23:18.228+00:00","severity":"info","message":"[output:http:] :port, HTTP status=200"}

Expected behavior Single log message only should appear when connection is established until the disconnection happens instead of multiple logs which will spam the container.

nikhithakarennagari commented 2 years ago

Could someone help with the issue? Thanks in advance.

max-ch-88 commented 2 years ago

I have the same problem. Fluentbit 1.9.8. I think these messages should be for log_level above INFO. Or users should be able to turn them off. I tried using Net.keepalive Off to disable these messages but with no result. Developers, please explain how to disable HTTP status=200 output. Thanks.

nikhithakarennagari commented 2 years ago

@edsiper , @LionelCons , Could you please support on this issue.

Tejaswi43 commented 2 years ago

@nikhithakarennagari , @max-ch-88 Facing same issue. These logs are spamming and our main use of reducing memory consumption using fluent bit 3pp is not met with this blocker. It would be great if someone could help us here, Thanks

nikhithakarennagari commented 2 years ago

I have the same problem. Fluentbit 1.9.8. I think these messages should be for log_level above INFO. Or users should be able to turn them off. I tried using Net.keepalive Off to disable these messages but with no result. Developers, please explain how to disable HTTP status=200 output. Thanks.

@max-ch-88 , in the Fluentbit code, https://github.com/fluent/fluent-bit/blob/master/plugins/out_http/http.c#L282 and https://github.com/fluent/fluent-bit/blob/master/plugins/out_http/http.c#L277 (flb_plugin_info) can be changed to (flb_plugin_debug) to avoid these messages in info mode. But in my opinion, there should be atleast a single info log which states the successful connectivity between fluent-bit and the http host.

github-actions[bot] commented 1 year ago

This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 5 days. Maintainers can add the exempt-stale label.

github-actions[bot] commented 1 year ago

This issue was closed because it has been stalled for 5 days with no activity.

max-ch-88 commented 1 year ago

in the Fluentbit code, https://github.com/fluent/fluent-bit/blob/master/plugins/out_http/http.c#L282 and https://github.com/fluent/fluent-bit/blob/master/plugins/out_http/http.c#L277 (flb_plugin_info) can be changed to (flb_plugin_debug) to avoid these messages in info mode.

@nikhithakarennagari Thanks for your suggestion, but I would like to have the out-of-the-box solution ) Could you reopen this issue?