mari-s4e
commented
6 months ago @sonjastndl when registering the bucket with s3browser I also get the error "not allowed to list all buckets", but it should be possible to connect to a named bucket anyway. Another thing that you should check is the AWS region, it should be eu-central-1.
FYI, I have set up an example script that shows how to connect to an s3 bucket with the Python library s3fs here: https://github.com/FAIRiCUBE/common-code/blob/main/access_data_apis/access_s3_bucket.py
sonjastndl
jetschny
Hi all. So far I have only worked on the EOX Hub in the UC specific bucket and only via eoxhub.fairicube.eu. It's still not entirely clear to me how to get access to the FiC common bucket.
There is a reference to https://s3browser.com/ in the FAIRiCUBE Notebook. Our IT team has now informed us that we at the NHM cannot use the software because the application is only licensed for personal use and we at the NHM would need a paid ProVersion which is not feasable at the NHM. I wanted to point this out first, maybe it is relevant for others as well.
There are several alternative AWS clients, including the command line tool s3cmd. Do you also have something like that? Experience and can recommend an alternative or including instructions?
FYI, I tried s3cmd myself: However, s3cmd cannot be successfully configured with the environmental variables from the FiC hub alone. The following parameters are required and my information about them would be in bold (Keys for this email are of course not written out but left as a variable): Access Key: ($S3_FAIRICUBE_STORAGE_KEY) Secret Key: ($S3_FAIRICUBE_STORAGE_SECRET) Default Region [US]: Default US S3 Endpoint [s3.amazonaws.com]: Default s3.amazonaws.com DNS-style bucket+hostname:port template for accessing a bucket: fairicube.s3.amazonaws.com I then get an Access Denied Error including “Are you sure your keys have s3:ListAllMyBuckets permissions?” which is documented here... Do our keys have those permissions?
If you have any tips or advice, that would be very helpful!
Best regards Sonja