search

improbable-eng / etcd-cluster-operator

A controller to deploy and manage etcd clusters inside of Kubernetes
MIT License
128 stars 35 forks source link

Restore #170

Closed wallrj closed 4 years ago

wallrj commented 4 years ago

Mostly @JamesLaverack 's work from https://github.com/improbable-eng/etcd-cluster-operator/compare/master...JamesLaverack:restore

With some additional changes to get the E2E tests passing.

Summary:

commit 60b54d0ca4a346750aac6b2f62771b14d77cba5c Author: James Laverack james.laverack@jetstack.io Date: Fri Feb 21 01:30:09 2020 +0000

Correct MinIO

commit f5cce659994ada4dad0d28629c33d697750e4361 Author: James Laverack james.laverack@jetstack.io Date: Thu Feb 20 23:14:14 2020 +0000

fixes

commit 7062036ee41611be9b3b407af78876d77234f985 Author: James Laverack james.laverack@jetstack.io Date: Thu Feb 20 23:07:38 2020 +0000

Correctly handle query params

commit f29b6604325ea04df30852500df716b012e371b0 Author: James Laverack james.laverack@jetstack.io Date: Thu Feb 20 22:47:09 2020 +0000

fix

commit b63ca7c9f47dc3dc35388b7f7da9bc64934d3482 Author: James Laverack james.laverack@jetstack.io Date: Thu Feb 20 22:46:38 2020 +0000

Move Dockerfile

commit f20896846a7af2fff6c4e76863c30091cefd12f9 Author: James Laverack james.laverack@jetstack.io Date: Thu Feb 20 22:44:30 2020 +0000

Master fixes

commit cd2ced70d30554c8f6b03a8cc396e80d0b7ec5d2 Author: James Laverack james.laverack@jetstack.io Date: Thu Feb 20 15:45:19 2020 +0000

Bring in line with master maybe

commit 155c8617a3e16371aef582b40e77efa29cf21d8f Author: James Laverack james.laverack@jetstack.io Date: Thu Feb 20 14:27:22 2020 +0000

fix kustomize

commit 4f85fe034fdbf19da1fd27da00d75b7787e8bad0 Author: James Laverack james.laverack@jetstack.io Date: Thu Feb 20 12:23:00 2020 +0000

 Deploy proxy

commit c4f6ac056a50dc4d18766083a6e7ee47eb003ca7 Author: James Laverack james.laverack@jetstack.io Date: Thu Feb 20 11:10:54 2020 +0000

Update API for restores

Only provide the raw URL, don't bother with different bucket and path
parts.

commit 2ba77635894f92ccdaeda1cadc861f698b0e076e Author: James Laverack james.laverack@jetstack.io Date: Thu Feb 20 10:57:05 2020 +0000

Finish out test code

commit 501d46ab45084a34e240d5bc128cf8cd83dd5268 Author: James Laverack james.laverack@jetstack.io Date: Thu Feb 20 00:16:34 2020 +0000

Simplify MinIO

commit 170585b752ca993f84d39f5851eba22e7bda2107 Author: James Laverack james.laverack@jetstack.io Date: Tue Feb 18 16:49:43 2020 +0000

Correctly wait on MinIO

commit b8b1ee5071ec1723336cfa2750d4f36aaedaf53a Author: James Laverack james.laverack@jetstack.io Date: Tue Feb 18 16:33:22 2020 +0000

Fix flag

commit 372feb50fb564722da7dcab67591cdf7d307d471 Author: James Laverack james.laverack@jetstack.io Date: Tue Feb 18 11:18:05 2020 +0000

Remove commented-out code

commit b48ac2d84b8d23444996d556458db71cd663ee29 Author: James Laverack james.laverack@jetstack.io Date: Thu Feb 6 11:51:52 2020 +0000

Download example MinIO YAML

commit 2db3d94de3d9ef8228f3ac59514030d830a1d6fc Author: James Laverack james.laverack@jetstack.io Date: Mon Feb 17 17:53:50 2020 +0000

More use URL

commit 2acabfb1ec07ff5300fbd939b8b23848107cafdb Author: James Laverack james.laverack@jetstack.io Date: Mon Feb 17 17:28:21 2020 +0000

Remove explicit dependancy on Viper

commit c27e8a44e3c5c4d38ab90a94b0abff42941405a2 Author: James Laverack james.laverack@jetstack.io Date: Mon Feb 17 16:45:21 2020 +0000

Use backupUrl and not cluster/backup identifier

commit 483a6a834bd99dc83910458099f14c2fc1d32575 Author: James Laverack james.laverack@jetstack.io Date: Fri Jan 17 17:33:16 2020 +0000

Implement EtcdRestore

Using older version of go-cloud to avoid import issue

Using the latest (v0.18.0) of go-cloud causes an import issue with an
ambigious import. That version isn't required, so we use v0.17.0
instead.

Update manifests

Correct name of JSON key

bucketUrl -> bucketURL

Remove placeholder comments

Document running as root

Configure context timeout in restoreagent

Remove empty else branches

Correct comment

Create event type constants

Export variables

Emit events from restore controller

Delete unused function

Move download code into proxy

Update CRD for EtcdRestore using v0.2.5
wallrj commented 4 years ago

E2E test is failing because the k8s cluster ran out of CPU:

        {
            "metadata": {
                "name": "my-cluster-0-swrgl.15f7426e55572033",
                "namespace": "teste2e-parallel-scaledown",
                "selfLink": "/api/v1/namespaces/teste2e-parallel-scaledown/events/my-cluster-0-swrgl.15f7426e55572033",
                "uid": "b8c5fe83-eb95-473f-8919-703c4912e6bc",
                "resourceVersion": "3617",
                "creationTimestamp": "2020-02-27T12:33:55Z"
            },
            "involvedObject": {
                "kind": "Pod",
                "namespace": "teste2e-parallel-scaledown",
                "name": "my-cluster-0-swrgl",
                "uid": "8f596619-6c03-422d-88e2-ae3d7e994633",
                "apiVersion": "v1",
                "resourceVersion": "3611"
            },
            "reason": "FailedScheduling",
            "message": "0/1 nodes are available: 1 Insufficient cpu.",
            "source": {
                "component": "default-scheduler"
            },
            "firstTimestamp": "2020-02-27T12:33:55Z",
            "lastTimestamp": "2020-02-27T12:33:55Z",
            "count": 2,
            "type": "Warning",
            "eventTime": null,
            "reportingComponent": "",
            "reportingInstance": ""
        },

-- https://1461-210613496-gh.circle-artifacts.com/0/tmp/etcd-e2e/teste2e-parallel-scaledown/teste2e-parallel-scaledown/events.json