search

coreos / etcd-operator

etcd operator creates/configures/manages etcd clusters atop Kubernetes
https://coreos.com/blog/introducing-the-etcd-operator.html
Apache License 2.0
1.75k stars 740 forks source link

e2e: add testing for GCS backup/restore #2018

Open hexfusion opened 5 years ago

hexfusion commented 5 years ago

We added GCS backend feature in https://github.com/coreos/etcd-operator/commit/b3b2f83f47961e29d47412ea84ecea308c549a52 but we need to add testing.

rusenask commented 5 years ago

Hi, just compiled and deployed this, thanks! :)

However, in the logs I am seeing:

time="2018-12-05T13:52:08Z" level=info msg="getMaxRev: endpoint http://dotmesh-etcd-cluster-client:2379 revision (1)"

and when I do:

gsutil cat gs://my-backup-object

It only seem to contain some data about members and peer URLs, not the actual key/values from my cluster. Therefore the restore can't do anything. Any tips on how to debug this?

hexfusion commented 5 years ago

It only seem to contain some data about members and peer URLs, not the actual key/values from my cluster.

@rusenask first thing in you can't review the KV contents of the snapshot with cat. What you see is in line with what is expected output from this command but the snapshot is a binary file. It sounds to me like it is working. If you really want to review the KV directly then try something like https://github.com/etcd-io/etcd/tree/master/tools/etcd-dump-db

Therefore the restore can't do anything. Any tips on how to debug this?

I don't understand are there errors?

In general it would be best for you to start a separate issue to debug this. This issue if for tracking adding e2e testing for GCS.

rusenask commented 5 years ago

thanks @hexfusion, will create a new one