CLOUD-850 - Update kuttl version to 0.16.0

tplavcic commented 1 month ago

CHANGE DESCRIPTION

New version of kuttl is out and it has some improvements so it would be good to update it.

CHECKLIST

Jira

[ ] Is the Jira ticket created and referenced properly?
[ ] Does the Jira ticket have the proper statuses for documentation (Needs Doc) and QA (Needs QA)?
[ ] Does the Jira ticket link to the proper milestone (Fix Version field)?

Tests

[ ] Is an E2E test/test case added for the new feature/change?
[ ] Are unit tests added where appropriate?

Config/Logging/Testability

[ ] Are all needed new/changed options added to default YAML files?
[ ] Are the manifests (crd/bundle) regenerated if needed?
[ ] Did we add proper logging messages for operator actions?
[ ] Did we ensure compatibility with the previous version or cluster upgrade process?
[ ] Does the change support oldest and newest supported PG version?
[ ] Does the change support oldest and newest supported Kubernetes version?

tplavcic commented 1 month ago

Some stack traces are thrown by kuttl in each test run, although it doesn't seem to affect the running of the test, but looks a bit bad:

    logger.go:42: 11:25:53 | tablespaces/2-verify-tablespace-volume | + i=4
[controller-runtime] log.SetLogger(...) was never called; logs will not be displayed.
Detected at:
    >  goroutine 25 [running]:
    >  runtime/debug.Stack()
    >   /nix/store/khpb8wx5dvf3bshb0iz9dm23z83r6niv-go-1.21.7/share/go/src/runtime/debug/stack.go:24 +0x5e
    >  sigs.k8s.io/controller-runtime/pkg/log.eventuallyFulfillRoot()
    >   /home/mowsiany/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.16.3/pkg/log/log.go:60 +0xcd
    >  sigs.k8s.io/controller-runtime/pkg/log.(*delegatingLogSink).WithName(0xc0002e5b80, {0x18220c3, 0x14})
    >   /home/mowsiany/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.16.3/pkg/log/deleg.go:147 +0x45
    >  github.com/go-logr/logr.Logger.WithName({{0x1a9af50, 0xc0002e5b80}, 0x0}, {0x18220c3?, 0x0?})
    >   /home/mowsiany/go/pkg/mod/github.com/go-logr/logr@v1.2.4/logr.go:336 +0x3d
    >  sigs.k8s.io/controller-runtime/pkg/client.newClient(0x12fd873?, {0x0, 0xc00041ab60, {0x1a9c4a0, 0xc0002e5100}, 0x0, {0x0, 0x0}, 0x0})
    >   /home/mowsiany/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.16.3/pkg/client/client.go:122 +0xec
    >  sigs.k8s.io/controller-runtime/pkg/client.New(0xc0001538c0?, {0x0, 0xc00041ab60, {0x1a9c4a0, 0xc0002e5100}, 0x0, {0x0, 0x0}, 0x0})
    >   /home/mowsiany/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.16.3/pkg/client/client.go:103 +0x7d
    >  github.com/kudobuilder/kuttl/pkg/test/utils.NewRetryClient(0xc0002de000?, {0x0, 0xc00041ab60, {0x1a9c4a0, 0xc0002e5100}, 0x0, {0x0, 0x0}, 0x0})
    >   /home/mowsiany/go/src/github.com/kudobuilder/kuttl/pkg/test/utils/kubernetes.go:177 +0x125
    >  github.com/kudobuilder/kuttl/pkg/test.(*Harness).Client(0xc0002de000, 0x0?)
    >   /home/mowsiany/go/src/github.com/kudobuilder/kuttl/pkg/test/harness.go:323 +0x194
    >  github.com/kudobuilder/kuttl/pkg/test.(*Step).Create(0xc0000b7ad0, 0xc00050c9c0, {0xc000049c00, 0x1b})
    >   /home/mowsiany/go/src/github.com/kudobuilder/kuttl/pkg/test/step.go:177 +0x63
    >  github.com/kudobuilder/kuttl/pkg/test.(*Step).Run(0xc0000b7ad0, 0xc000501fa0?, {0xc000049c00, 0x1b})
    >   /home/mowsiany/go/src/github.com/kudobuilder/kuttl/pkg/test/step.go:457 +0x25a
    >  github.com/kudobuilder/kuttl/pkg/test.(*Case).Run(0xc0003015e0, 0xc00050c9c0, 0xc000122a80)
    >   /home/mowsiany/go/src/github.com/kudobuilder/kuttl/pkg/test/case.go:362 +0x7f6
    >  github.com/kudobuilder/kuttl/pkg/test.(*Harness).RunTests.func1.1(0xc00050c9c0)
    >   /home/mowsiany/go/src/github.com/kudobuilder/kuttl/pkg/test/harness.go:401 +0x1cb
    >  testing.tRunner(0xc00050c9c0, 0xc000263518)
    >   /nix/store/khpb8wx5dvf3bshb0iz9dm23z83r6niv-go-1.21.7/share/go/src/testing/testing.go:1595 +0xff
    >  created by testing.(*T).Run in goroutine 24
    >   /nix/store/khpb8wx5dvf3bshb0iz9dm23z83r6niv-go-1.21.7/share/go/src/testing/testing.go:1648 +0x3ad
    logger.go:42: 11:25:54 | tablespaces/2-verify-tablespace-volume | test step completed 2-verify-tablespace-volume

tplavcic commented 1 month ago

There's a ticket open here: https://github.com/kudobuilder/kuttl/issues/505

JNKPercona commented 1 month ago

Test name	Status
custom-extensions	passed
demand-backup	passed
init-deploy	passed
monitoring	passed
one-pod	passed
operator-self-healing	passed
pitr	passed
scaling	passed
scheduled-backup	passed
self-healing	passed
start-from-backup	passed
tablespaces	passed
telemetry-transfer	passed
upgrade-consistency	passed
upgrade-minor	passed
users	passed
We run 16 out of 16

commit: https://github.com/percona/percona-postgresql-operator/pull/799/commits/1b5ad49ade3fbeb75ca2c30de080aab3f76cb060 image: perconalab/percona-postgresql-operator:PR-799-1b5ad49ad

percona / percona-postgresql-operator

CLOUD-850 - Update kuttl version to 0.16.0 #799

CHANGE DESCRIPTION

CHECKLIST