http://cinhtau.net/2017/01/17/backup-your-elasticsearch-data-with-amazon-s3/

[utterances-bot]

Backup your Elasticsearch data with Amazon S3

As I mentioned before, how easy it is to backup your Elasticsearch data with the snapshot and restore API, today’s post demonstrates how to backup the data t...

http://cinhtau.net/2017/01/17/backup-your-elasticsearch-data-with-amazon-s3/

[Dev393]

Hi @TAN-VINH NGUYEN,

I am following this article for my hosted elasticsearch infra, I have connection from my hosted environment to AWS.

If i try the below command:

PUT _snapshot/_snapshot { "type": "s3", "settings": { "bucket": "bucketname", "compress": true, "region": "eu-west-1" } }

It says an error below:

{ "error": { "root_cause": [ { "type": "repository_verification_exception", "reason": "[_snapshot] path is not accessible on master node" } ], "type": "repository_verification_exception", "reason": "[_snapshot] path is not accessible on master node", "caused_by": { "type": "i_o_exception", "reason": "Unable to upload object [tests-le_4s48bQcK1U3QmPgRJ8A/master.dat] using a single upload", "caused_by": { "type": "sdk_client_exception", "reason": "sdk_client_exception: The requested metadata is not found at http://169.254.169.254/latest/meta-data/iam/security-credentials/" } } }, "status": 500 }

can you guide me how to proceed here?

[cinhtau]

Please format code with Markdown. :wink:

[cinhtau]

You can not name the snapshot repository _snapshot. That is what you have tried in above command.

[_snapshot] path is not accessible on master node

To create a snapshot repository names s3

PUT _snapshot/s3
{
  "type": "s3",
  "settings": {
     "bucket": "enter your bucketname",
     "compress": true,
     "region": "change this to your region of the bucket"
   }
}

[Dev393]

Tried that as well.

[Matrix7867]

@cinhtau Thanks for the great article!! helped me a lot. Can you also help me how to restore the same indices in any new cluster of ES?

[cinhtau]

@Matrix7867 Hi, thank you for your feedback. I do not do consulting in working hours, but I could write a follow up article. Basically it is these steps:

• Install aws-s3 plugin in new Elasticsearch installation
• Add existing snapshot repository to new Elasticsearch cluster
• Verify that you can see the backups/snapshots
• Restore the backup with the restore API

curl -X POST "localhost:9200/_snapshot/my_backup/snapshot_1/_restore?pretty"