NetApp / netapp-dataops-toolkit

The NetApp DataOps Toolkit is a Python library that makes it simple for developers, data scientists, DevOps engineers, and data engineers to perform various data management tasks, such as near-instantaneously provisioning, cloning, or snapshotting a data volume or JupyterLab workspace.
BSD 3-Clause "New" or "Revised" License
46 stars 12 forks source link

Error: S3 API error: Invalid endpoint: #15

Open charlesmorrall opened 2 years ago

charlesmorrall commented 2 years ago

I'm trying out the DataOps toolkit in my lab. VM with Ubuntu 20.04 Onprem StorageGrid 11.5.0.6-20220127.2356.43733aa

Configured a tenant and endpoint.

Works with s3cmd, but not the Dataops toolkit

root@dataops1:~# s3cmd put foo2 s3://foo4 --host=s3.frontlab.org --no-check-certificate --signature-v2 
upload: 'foo2' -> 's3://foo4/foo2'  [1 of 1]
 0 of 0     0% in    0s     0.00 B/s  done
root@dataops1:~#  netapp_dataops_cli.py push-to-s3 file --bucket=foo4 --file foo2
Error: S3 API error:  Invalid endpoint: s3.frontlab.org
root@dataops1:~#

Bit of a loss here, are there any logs I can examine?

scaleoutsean commented 2 years ago

Check your user's ~/.netapp_dataops/config.json and adjust if necessary. (My config works with both false and true in s3VerifySSLCert.)

{
  "verifySSLCert": false, 
  "s3Endpoint": "https://s3.com.org.net:443", 
  "s3AccessKeyId": "AAAAAAAAAAAAAAA", 
  "s3SecretAccessKey": "BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB", 
  "s3VerifySSLCert": true, 
  "s3CACertBundle": ""
}

image

By the way, why do you insist on signature v2 in s3cmd?