search

awslabs / mountpoint-s3-csi-driver

Built on Mountpoint for Amazon S3, the Mountpoint CSI driver presents an Amazon S3 bucket as a storage volume accessible by containers in your Kubernetes cluster.
Apache License 2.0
207 stars 25 forks source link

Support clusters using third-party S3-like services #248

Open ehsan310 opened 2 months ago

ehsan310 commented 2 months ago

/feature

Is your feature request related to a problem? Please describe. It is not possible to use S3 clusters out of AWS

Describe the solution you'd like in detail It would be nice to support S3 Compatible interfaces for locally deployed clusters like Ceph

Describe alternatives you've considered Had to run a sidecar container along with deployment and use s3fs instead.

dannycjones commented 1 month ago

Hey @ehsan310, thanks for opening an issue.

While we don't provide support for S3-like services, we do welcome contributions of minor compatibility fixes or performance improvements for these services if the changes can be tested against Amazon S3. We had a similar issue over on the Mountpoint repository https://github.com/awslabs/mountpoint-s3/issues/144 where you can read more.

I'm aware of some features not supported by some S3-like services such as additional checksums. Mountpoint uses CRC32C by default but where the S3-like service doesn't support it, it is possible to disable using --upload-checksums off. This was added partly for this issue: https://github.com/awslabs/mountpoint-s3/issues/853.

If you can identity why the mount is failing from the logs, that may be useful for those coming across this issue in future. Information on logging in Mountpoint with the CSI driver can be found in our docs: https://github.com/awslabs/mountpoint-s3-csi-driver/blob/main/docs/LOGGING.md.