search

fluent / fluent-plugin-s3

Amazon S3 input and output plugin for Fluentd
https://docs.fluentd.org/output/s3
314 stars 218 forks source link

S3 Access Point support #313

Closed csolidum closed 4 years ago

csolidum commented 4 years ago

It looks like the s3 output plugin doesn't support making requests via S3 access points.

According to the access point docs, you would need make the s3 endpoint point to <access_point_name>-<account_id>.s3-accesspoint.<region>.amazonaws.co. setting the s3_endpoint config option to this i get an exception that s3_endpoint parameter is not supported for S3, use s3_region instead.

Is there a config option to make the S3 plugin use the access point endpoint instead of the generic S3 one? If not, could we allow using the s3_endpoint for this usecase?

ganmacs commented 4 years ago

You can use access point docs without s3_endpoint. Set s3_bucket to arn of access point like arn:aws:s3:us-west-2:123456789012:accesspoint/prod in example of https://docs.aws.amazon.com/AmazonS3/latest/dev/using-access-points.html#access-points-monitoring-logging

s3_endpoint is deprecated. I believe we don't have to support it again since AWS provides other way to do anything without using s3_endpoint.