Closed vi4vikas closed 6 days ago
Can you try with the latest version 3.0.7?
Sure can! However, I couldn't see any fix in the later version for the S3 plugin.
It may be TLS related though looking at the stack, plus always best to try with the latest version anyway to confirm.
This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 5 days. Maintainers can add the exempt-stale
label.
This issue was closed because it has been stalled for 5 days with no activity.
Bug Report
I am getting the following error intermittently in my Fluent bit Logs, due to which it is failing to upload the log files to the S3 bucket. Full error log:
I am using Fluent-bit version 2.2.0 and is configured as:
Fluent-Bit configurations:
Resources allocated to Fluent-Bit pods:
I have recently set the retry_limit to 5 as it was set to 1 by default
Edit: The update of retry_limit didn't help. Edit: Cannot attach the snapshot of the metrics here, but the improvement seen is around 90%
It's not uniform but each fluent-bit pod opens around 1200 files in an hour (output of fluentbit_input_files_opened_total{})
The infrastructure is not broken, I can see most of the logs. But it's just that a few logs are missed while Fluent-bit suffers from the issue. I saw the same issue raised in the past, I cannot see anyone being concluded to a solution or a fix. Is there something I need to configure or is it an ongoing issue?
Please let me know if there is any more information required for the resolution.