Run acceptance tests (FVT) with OCP 4.16 and k8s 1.29

OpenLiberty / open-liberty-operator

Eclipse Public License 2.0

28 stars 36 forks source link

Run acceptance tests (FVT) with OCP 4.16 and k8s 1.29 #576

Open leochr opened 2 months ago

leochr commented 2 months ago

Use the latest version of WLO and

[x] run acceptance tests with OCP 4.16 on all supported platforms (X, P and Z)
[x] run acceptance tests on non-OCP with Kubernetes 1.29

halim-lee commented 2 months ago

All kuttl tests passed on kindest/node:v1.29.4: test result

leochr commented 2 weeks ago

@halim-lee It could be awhile before Fyre officially adds 4.16 support. Let's use the OCP pre-release capability in our OnePipeline to run the WLO FVT on XYZ with 4.16 by setting pre-release to true. I already updated pre-release-* flags accordingly to use 4.16. Thank you

halim-lee commented 2 weeks ago

@leochr The tests passed on OCP 4.16 X except for routes test.

        Name: routes
        State: fail

        Errors:
                resource Route:operator-test/route: .spec.host: value mismatch, expected: route-operator-test.foo.bar.com != actual: route-operator-test.apps.was-416.cp.fyre.ibm.com

This test fails on 4.15 locally. For AllNamespaces mode, the defaultHostname needs to be set for ConfigMap in openshift-operators namespace.

halim-lee commented 2 weeks ago

Tests all pass in OwnNamespace mode. Routes test will need a change for AllNamespaces mode.

All tests passed on OCP 4.16: https://cloud.ibm.com/devops/pipelines/tekton/c3b2797d-c8ad-4dab-9660-2ec8c0643a76/runs/0fb4358c-107d-4368-a7df-28b48b21e491/deploy-acceptance-tests/run-stage?env_id=ibm:yp:us-south