opensearch-project / opensearch-devops

:smile: We welcome all the community members to help develop third party tools/automations/workflows for OpenSearch/OpenSearch-Dashboards.
https://opensearch.org/
Apache License 2.0
45 stars 36 forks source link

How to take s3 backup from OpenSearch to mini-io with https protocol in kubernates cluster. #177

Open ganilmca opened 4 months ago

ganilmca commented 4 months ago

Is your feature request related to a problem? Please describe

Hi Team,

We were unable to take s3 backup from opensearch to min-io with https protocol.

We added the below 2 lines in values.yaml file. s3.client.default.endpoint: endpoint:30000 s3.client.default.protocol: https

We are using the below command to register the repo curl -k -XPUT -u admin:admin "https://opensearch-cluster-master-0:9200/_snapshot/s3_repo?pretty" -H 'Content-Type: application/json' -d' { "type": "s3", "settings": { "bucket": "bucket1", "base_path": "s3_repo", "path_style_access": true, "compress": true, "chunk_size": "500mb", "buffer_size": "50mb", "region": "default"

} }'

Abel to register the repo here.

But when i want to take backup by using the below command. curl -k -XPUT -u admin:admin 'https://opensearch-cluster-master-0:9200/_snapshot/s3_repo/snapshot1?wait_for_completion=true&pretty' -H 'Content-Type: application/json' -d' { "indices": "test*", "ignore_unavailable": true, "include_global_state": true, "region": "default" }'

We are getting the below error: "type" : "sdk_client_exception", "reason" : "sdk_client_exception: Request attempt 3 failure: Unable to execute HTTP request: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target"

"reason" : "sdk_client_exception: Request attempt 3 failure: Unable to execute HTTP request: The target server failed to respond"

Can anyone please help to get it work, and also how to add min-io cetificate to opensearch, how to add proxy.host and proxy.port in helm charts.

Thanks & Regards, Anil.

Describe the solution you'd like

We want procedure like how to add cert file in helm charts and how to add proxy in helm charts and other parameter need to add from our side.

Related component

Plugins

Describe alternatives you've considered

No response

Additional context

No response

gaiksaya commented 4 months ago

Hi @ganilmca , Thank you opening the issue. Were you able to go through this forum post about the same issue: https://forum.opensearch.org/t/use-minio-as-snapshot-repository-failed-if-use-https/2749/2

ganilmca commented 3 months ago

hi @gaiksaya,

We have gone through the above link, unfortunately that was not working for me even i have followed the same steps. will get the below error every time.

"reason" : "sdk_client_exception: Request attempt 3 failure: Unable to execute HTTP request: The target server failed to respond"

Please tell us how to pass the minio client certs from opensearch config side.

It will help us if you send me those details.

Thanks, Anil