fluent / fluent-plugin-s3

Amazon S3 input and output plugin for Fluentd
https://docs.fluentd.org/output/s3
314 stars 218 forks source link

Fluentd logs are sent to s3 with delayed time #333

Closed smiley-ci closed 3 years ago

smiley-ci commented 4 years ago

We are using s3 output plugin and we see old logs data are been sent to s3. We are using *.log Uploads to S3 were successful, the chunks were deleted from the buffer. It looked like the old logs are just being added by tail/generated by application. Fluentd conf

 @type tail
 path "/var/log/containers/*.log"
 pos_file "/fluentd/pos/containers.log.pos"
 time_format %Y-%m-%dT%H:%M:%S.%L%Z
 tag "kubernetes.*"

Can someone help me to figure out this issue

github-actions[bot] commented 3 years ago

This issue has been automatically marked as stale because it has been open 90 days with no activity. Remove stale label or comment or this issue will be closed in 30 days

github-actions[bot] commented 3 years ago

This issue was automatically closed because of stale in 30 days