fluent / fluent-plugin-s3

Amazon S3 input and output plugin for Fluentd
https://docs.fluentd.org/output/s3
314 stars 218 forks source link

S3 output hardcodes amazon domain #263

Closed matt14483 closed 3 years ago

matt14483 commented 5 years ago

The s3 output plugin takes the region, bucket name, and assumes amazonaws.com for the s3 endpoint. However, some other environments do not use amazonaws.com, and rather a different domain for the s3 endpoint. If we can make that a parameter, I can avoid a DNS mess to get my data to the proper endpoints.

repeatedly commented 5 years ago

You can use s3_endpoint for that case: https://github.com/fluent/fluent-plugin-s3#configuration-output

boenr1 commented 4 years ago

The s3_endpoint is deprecated: https://docs.fluentd.org/output/s3

This option is deprecated because latest aws-sdk ignores this option. Please use s3_region instead.
The Amazon S3 enpoint name. Please select the appropriate endpoint name from the list below and confirm that your bucket has been created in the correct region.

So is there another possibility? I also want to use the s3 output with an storage grid S3 and not AWS.

repeatedly commented 4 years ago

s3_endpoint should work with compatible service. Check s3_endpoint in README: https://github.com/fluent/fluent-plugin-s3

We will remove s3_endpoint from official article because it is deprecated for main purpose. Hard to sync with README.

github-actions[bot] commented 3 years ago

This issue has been automatically marked as stale because it has been open 90 days with no activity. Remove stale label or comment or this issue will be closed in 30 days

kenhys commented 3 years ago

Resolved by https://github.com/fluent/fluent-plugin-s3/issues/263#issuecomment-451672862