search

thumbor-community / aws

Thumbor AWS extensions
MIT License
155 stars 70 forks source link

Feature Request - Multiple S3 bucket support for image loader piece #158

Open meetshubhamku opened 1 year ago

meetshubhamku commented 1 year ago

Feature Description

We are using thumbor and the setup is currently running on aws cloud.

Our images are stored on aws s3. The bucket is private and we are accessing the bucket using the plugin which is provided by tc_aws. The plugin allows us to access our images (objects) which are there in our private s3 bucket.

The only problem we are facing is that the plugin supports only one bucket as a part of the configuration. We are planning to distribute the images in other buckets. We know that we can use the same bucket and add some path prefix but due to some reasons we cant do that and are planning to create few more buckets.

So please let us know is it possible to add multi bucket support in the loader piece?

Bladrak commented 1 year ago

The standard implementation for that would be to have multiple thumbor processes with different configurations, and a process balancer in front such as supervisor.