search

EOEPCA-archive / rm-bucket-operator

Apache License 2.0
0 stars 0 forks source link

CREODIAS dependency #1

Open ghost opened 1 year ago

ghost commented 1 year ago

Hello, Currently the bucket operator is dependent on the CREODIAS' API in order to create S3 buckets.

Since we are not using it, this is a blocking issue for us.

Could you add some other options for creating S3 buckets.

rconway commented 1 year ago

We are currently (current sprint) re-architecting the bucket operator to make it easier to be adapted to different cloud providers. It is not possible to create a universal 'works everywhere' solution - instead we are trying to isolate the needed custom part to be as small as possible.

What cloud / S3-backend are you using?

ghost commented 1 year ago

Hello,

We are using Dell ECS appliance.

rconway commented 1 year ago

There are many cloud and object storage solutions. We are not able to implement a solution for each of these. We have CREODIAS (openstack) and will also integrate with minio for an out-of-the-box experience. The above-mentioned re-architecture will minimise the work required to provide a custom solution for your particular environment - to provision a bucket within your backend solution - assuming that the Dell ECS has an API that supports this. We can image to establish a community contributed library of solutions for different backends - in addition to the CREODIAS (openstack) and minio that we are providing.

ghost commented 1 year ago

ECS has SWIFT API compatible API. Does CREODIAS uses SWIFT for object storage? Openstack define the cloud layer technology and not necessary the Object Storage, so when you talk of OpenStack is not clear what is the Object Storage module used.

rconway commented 1 year ago

It's possible that openstack uses Swift for object storage - with an S3 compatibility layer. I'll check with the team what interface our CREODIAS bucket implementation uses - perhaps it relies on the Swift API. @constantinius do you have any insight here?

constantinius commented 1 year ago

The CREODIAS bucket operator uses the Openstack as well as the AWS S3 API to interact with the Swift buckets. I have the impressio, that Openstack Swift is somewhat an extension to the S3 protocol, thus both are needed to fully support the actions required.

rconway commented 1 year ago

OK - so sounds like the 'CREODIAS' operator will not work with 'pure' Swift