search

tomohisaota / fluent-plugin-forward-aws

Fluentd input/output plugin to forward logs through AWS S3 + SNS + SQS
Other
12 stars 7 forks source link

S3 input plugin usage #8

Open amagnus opened 10 years ago

amagnus commented 10 years ago

Hello,

We are trying to pull logs from S3 bucket using fluentd. Is fluent-plugin-forward-aws the right fit for the job? If not, do you recommend any S3 input plugin?

Thanks!

tomohisaota commented 10 years ago

No, fluent-plugin-forward-aws does not support pulling generic logs from s3 bucket. It uses S3 as internal storage with custom formatted logs.

And I don't know any log input plugin which support S3.

tomohisaota commented 10 years ago

Amazon added S3 event notification recently. It will be not so hard to write plugin to trigger on notification.