Support IBM Cloud Object Storage for S3 snapshots

ppf2 commented 4 years ago

IBM Cloud Object Storage supports a subset of the S3 API.

Even if it does work today, there are a few risks

In the future, we might change something in Elasticsearch that requires a part of the S3 API that IBM's version doesn't support
There might be edge cases that will break the snapshot/restore implementation today

This is a request for us to start officially testing against IBM Cloud Object Storage like we do for S3 and Minio so we can make it an officially supported storage option for our S3 snapshot/restore functionality.

elasticmachine commented 4 years ago

Pinging @elastic/es-distributed (:Distributed/Snapshot/Restore)

DaveCTurner commented 3 years ago

I have opened an issue with the infra team to set up the test jobs we would need to satisfy this.

original-brownbear commented 2 years ago

It seems the infra issue on this never went anywhere. Do we still want this? It seems now that we have the repository compatibility API and advice using it this is less of a concern and not worth the effort any longer?

DaveCTurner commented 2 years ago

I can confirm that this is still a concern.

elastic / elasticsearch

Support IBM Cloud Object Storage for S3 snapshots #62973