search

sodafoundation / strato

SODA Strato (Multi-cloud) project provides a cloud vendor agnostic data management for hybrid cloud, intercloud or intracloud. This project is renamed as 'Strato'
Apache License 2.0
234 stars 329 forks source link

Unable to add a Cloud backend #1412

Open rajesh1084 opened 1 year ago

rajesh1084 commented 1 year ago

Issue/Feature Description: Deployed Soda multi-cloud as per the instructions in the documentation. Enabled all the required projects and parameters in the yaml files. However, in the UI, when I try to register a new cloud backend, the drop-down doesn't show up any values. Refer to the screenshot.

Why this issue to fixed / feature is needed(give scenarios or use cases):

How to reproduce, in case of a bug:

Other Notes / Environment Information: (Please give the env information, log link or any useful information for this issue) Soda was deployed on a single VM (Ubuntu 20.04.4 LTS)

image

anvithks commented 1 year ago

@rajesh1084 seems like all the strato (multicloud) docker containers have not come up properly. The Backend types API call seems to be failing.

Could you try the following and post the screenshots here:

  1. docker ps -a
  2. Enable the developer console in the browser (usually F12 should bring it up) and screenshot the error that is shown when you click on the Register Backend button.

If the installation was interrupted in between, or if you have shutdown the system and restarted this issue may arise. In these cases you can run the ansible clean playbook and run the installation again.

rajesh1084 commented 1 year ago

Sure @anvithks , I will post those details in a while.

If the installation was interrupted in between No, it wasn't.

you can run the ansible clean playbook and run the installation again Done that twice.

anvithks commented 1 year ago

typo: seems like all the strato (multicloud) docker containers have not come up properly

rajesh1084 commented 1 year ago

Looks like mongodb container is restarting with the warning - WARNING: MongoDB 5.0+ requires a CPU with AVX support, and your current system does not appear to have that!

My base system does have avx/avx2 supported CPU, but the VirtualBox VM doesn't have it.

image

image

rajesh1084 commented 1 year ago

Closing this issue as I am able to bring up strato on a different setup and able to see the cloud backends.

anvithks commented 1 year ago

Closing this issue as I am able to bring up strato on a different setup and able to see the cloud backends.

That's great @rajesh1084. Let me know if you face any other issues.

rajesh1084 commented 1 year ago

While it lists a set of cloud backends, when we try to register an AWS S3 bucket, it's failing -

caused by: Put "http://sample22fc6593-de0f-4c85-be2b-9c3d56982f4c.persoanl-soda-test-bucket/": dial tcp: lookup sample22fc6593-de0f-4c85-be2b-9c3d56982f4c.persoanl-soda-test-bucket: no such host
[2023-03-14T11:19:49Z] [ERROR] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/datastore/aws/aws.go] [aws.(*AwsAdapter).BackendCheck():438] [PID:9] failed to create sample bucket :RequestError: send request failed
caused by: Put "http://sample22fc6593-de0f-4c85-be2b-9c3d56982f4c.persoanl-soda-test-bucket/": dial tcp: lookup sample22fc6593-de0f-4c85-be2b-9c3d56982f4c.persoanl-soda-test-bucket: no such host
[2023-03-14T11:19:49Z] [ERROR] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/service/service.go] [service.(*s3Service).BackendCheck():580] [PID:9] failed due to wrong backend details, err:RequestError: send request failed
caused by: Put "http://sample22fc6593-de0f-4c85-be2b-9c3d56982f4c.persoanl-soda-test-bucket/": dial tcp: lookup sample22fc6593-de0f-4c85-be2b-9c3d56982f4c.persoanl-soda-test-bucket: no such host

[2023-03-14T11:19:49Z] [INFO] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/service/service.go] [service.(*s3Service).BackendCheck():562] [PID:9] BackendCheck is called in s3 service.
[2023-03-14T11:19:49Z] [INFO] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/datastore/aws/aws.go] [aws.(*AwsAdapter).BucketCreate():71] [PID:9] Bucket create is called in aws service and input request is:name:"sample0364791d-5ab8-42eb-bc20-f12dcd8e621a"
[2023-03-14T11:19:49Z] [ERROR] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/datastore/aws/aws.go] [aws.(*AwsAdapter).BucketCreate():80] [PID:9] the create bucket failed in aws-s3 service with err:%sRequestError: send request failed
caused by: Put "http://sample0364791d-5ab8-42eb-bc20-f12dcd8e621a.persoanl-soda-test-bucket/": dial tcp: lookup sample0364791d-5ab8-42eb-bc20-f12dcd8e621a.persoanl-soda-test-bucket: no such host
[2023-03-14T11:19:49Z] [ERROR] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/datastore/aws/aws.go] [aws.(*AwsAdapter).BackendCheck():438] [PID:9] failed to create sample bucket :RequestError: send request failed
caused by: Put "http://sample0364791d-5ab8-42eb-bc20-f12dcd8e621a.persoanl-soda-test-bucket/": dial tcp: lookup sample0364791d-5ab8-42eb-bc20-f12dcd8e621a.persoanl-soda-test-bucket: no such host
[2023-03-14T11:19:49Z] [ERROR] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/service/service.go] [service.(*s3Service).BackendCheck():580] [PID:9] failed due to wrong backend details, err:RequestError: send request failed
caused by: Put "http://sample0364791d-5ab8-42eb-bc20-f12dcd8e621a.persoanl-soda-test-bucket/": dial tcp: lookup sample0364791d-5ab8-42eb-bc20-f12dcd8e621a.persoanl-soda-test-bucket: no such host

[2023-03-14T11:21:21Z] [INFO] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/service/service.go] [service.(*s3Service).BackendCheck():562] [PID:9] BackendCheck is called in s3 service.
[2023-03-14T11:21:21Z] [INFO] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/datastore/aws/aws.go] [aws.(*AwsAdapter).BucketCreate():71] [PID:9] Bucket create is called in aws service and input request is:name:"sampled9007664-1c5b-43d9-b558-67dc3ecea2f2"
[2023-03-14T11:21:22Z] [ERROR] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/datastore/aws/aws.go] [aws.(*AwsAdapter).BucketCreate():80] [PID:9] the create bucket failed in aws-s3 service with err:%sRequestError: send request failed
caused by: Put "http://sampled9007664-1c5b-43d9-b558-67dc3ecea2f2.soda-123-bucket/": dial tcp: lookup sampled9007664-1c5b-43d9-b558-67dc3ecea2f2.soda-123-bucket: no such host
[2023-03-14T11:21:22Z] [ERROR] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/datastore/aws/aws.go] [aws.(*AwsAdapter).BackendCheck():438] [PID:9] failed to create sample bucket :RequestError: send request failed
caused by: Put "http://sampled9007664-1c5b-43d9-b558-67dc3ecea2f2.soda-123-bucket/": dial tcp: lookup sampled9007664-1c5b-43d9-b558-67dc3ecea2f2.soda-123-bucket: no such host
[2023-03-14T11:21:22Z] [ERROR] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/service/service.go] [service.(*s3Service).BackendCheck():580] [PID:9] failed due to wrong backend details, err:RequestError: send request failed
caused by: Put "http://sampled9007664-1c5b-43d9-b558-67dc3ecea2f2.soda-123-bucket/": dial tcp: lookup sampled9007664-1c5b-43d9-b558-67dc3ecea2f2.soda-123-bucket: no such host

[2023-03-14T11:21:22Z] [INFO] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/service/service.go] [service.(*s3Service).BackendCheck():562] [PID:9] BackendCheck is called in s3 service.
[2023-03-14T11:21:22Z] [INFO] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/datastore/aws/aws.go] [aws.(*AwsAdapter).BucketCreate():71] [PID:9] Bucket create is called in aws service and input request is:name:"sample8db4ac74-90ed-48fb-99c6-afff6f66b19a"
[2023-03-14T11:21:22Z] [ERROR] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/datastore/aws/aws.go] [aws.(*AwsAdapter).BucketCreate():80] [PID:9] the create bucket failed in aws-s3 service with err:%sRequestError: send request failed
caused by: Put "http://sample8db4ac74-90ed-48fb-99c6-afff6f66b19a.soda-123-bucket/": dial tcp: lookup sample8db4ac74-90ed-48fb-99c6-afff6f66b19a.soda-123-bucket: no such host
[2023-03-14T11:21:22Z] [ERROR] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/datastore/aws/aws.go] [aws.(*AwsAdapter).BackendCheck():438] [PID:9] failed to create sample bucket :RequestError: send request failed
caused by: Put "http://sample8db4ac74-90ed-48fb-99c6-afff6f66b19a.soda-123-bucket/": dial tcp: lookup sample8db4ac74-90ed-48fb-99c6-afff6f66b19a.soda-123-bucket: no such host
[2023-03-14T11:21:22Z] [ERROR] [/home/root1/multi-cloud-new/multi-cloud/s3/pkg/service/service.go] [service.(*s3Service).BackendCheck():580] [PID:9] failed due to wrong backend details, err:RequestError: send request failed
caused by: Put "http://sample8db4ac74-90ed-48fb-99c6-afff6f66b19a.soda-123-bucket/": dial tcp: lookup sample8db4ac74-90ed-48fb-99c6-afff6f66b19a.soda-123-bucket: no such host
anvithks commented 1 year ago

[PID:9] failed due to wrong backend details,

@rajesh1084 Seems like the backend information provided may be incorrect.

Have you generated the AK/SK in SODA Dashboard? Did you enable storage service plans and use it to create a bucket?

rajesh1084 commented 1 year ago

Have you generated the AK/SK in SODA Dashboard?

No, we haven't generated AK/SK in the dashboard; but using the AK/SK of our AWS a/c. I believe, AK/SK in SODA is required after we register the backend (to access the S3 bucket from SODA UI). Is that a wrong understanding?

Did you enable storage service plans and use it to create a bucket?

Yes. We did set enable_storage_service_plans: true in group_vars/common.yml.

Following this documentation trying with the following values: Endpoint: s3.us-west-2.amazonaws.com // My a/c is in us-west-2 region AK/SK: generated from AWS console

Any pointers?