stackabletech / issues

This repository is only for issues that concern multiple repositories or don't fit into any specific repository
2 stars 0 forks source link

Run/check getting-started scripts + integration tests for 24.7 #613

Closed maltesander closed 1 month ago

maltesander commented 1 month ago

For each operator with a getting_started.sh script, run the following:

git fetch
git checkout release-24.7

# Some of the scripts are in a code/ subdirectory
# pushd docs/modules/superset/examples/getting_started
# pushd docs/modules/superset/examples/getting_started/code
pushd $(fd -td getting_started | grep examples); cd code 2>/dev/null || true

# Make a fresh cluster (~12 seconds)
kind delete cluster && kind create cluster
./getting_started.sh stackablectl

# Make a fresh cluster (~12 seconds)
kind delete cluster && kind create cluster
./getting_started.sh helm

popd

Then run integration tests:

# Make a fresh cluster (~12 seconds)
kind delete cluster && kind create cluster
./scripts/run-tests --test-suite nightly

x86_64

### Tasks
- [x] airflow-operator @NickLarsenNZ
- [x] https://github.com/stackabletech/druid-operator/pull/602 https://github.com/stackabletech/druid-operator/pull/603 @NickLarsenNZ
- [x] https://github.com/stackabletech/hbase-operator/pull/536 https://github.com/stackabletech/hbase-operator/pull/537 @NickLarsenNZ
- [ ] https://github.com/stackabletech/hdfs-operator/pull/562
- [x] hello-world-operator (integration tests only) @Techassi
- [x] hive-operator @Techassi
- [ ] https://github.com/stackabletech/kafka-operator/pull/738
- [x] listener-operator (integration tests only) @Techassi
- [x] nifi-operator @Techassi
- [x] opa-operator @Techassi
- [x] secret-operator (integration tests only) @Techassi
- [x] spark-k8s-operator @Techassi
- [x] superset-operator @Techassi
- [x] trino-operator @Techassi
- [x] ZooKeeper-operator @Techassi

aarch64

### Tasks
- [x] airflow-operator @Maleware
- [x] druid-operator @Maleware
- [x] hbase-operator @Maleware
- [x] hello-world-operator  (integration tests only)
- [x] hdfs-operator @Maleware
- [x] hive-operator @Maleware
- [x] kafka-operator @Maleware
- [x] listener-operator (integration tests only) @Maleware
- [x] nifi-operator @Maleware
- [x] opa-operator @Maleware
- [x] secret-operator (integration tests only) @Maleware
- [x] spark-k8s-operator @Maleware
- [x] superset-operator @Maleware
- [x] trino-operator @Maleware
- [x] zookeeper-operator @Maleware

[!IMPORTANT] kafka-operator requires kafkacat (kcat in nix)

[!NOTE] The list above was generated by:

# cd to directory where you store the stackabletech repos locally
find -name 'getting_started.sh' -or -name 'test-definition.yaml' -not -path './operator-templating/*' \
| cut -d/ -f2 \
| sort \
| uniq \
| grep -- -operator \
| sed 's/^/- [ ] /'

If you want to reuse a cluster, you can delete everything by doing:

# Delete Stackable Custom Resources
kubectl get crds | grep stackable | cut -d' ' -f1 | xargs -I {} kubectl -n default delete {} --all

# Delete well-known Kubernetes Resources in the default namespace
kubectl -n default delete all --all --grace-period 0

# Delete the operators
stackablectl release uninstall 24.7

# delete the Stackable Custom Resource Definitions
kubectl get crds | grep stackable | cut -d' ' -f1 | xargs -I {} kubectl delete crd {}

# You might need to check on any Helm releases
helm list
helm uninstall ....
NickLarsenNZ commented 1 month ago

A handy command to add to the long running commands to remind you when it finishes:

#             secs     freq
play -n synth 0.25 tri 800.0
NickLarsenNZ commented 1 month ago

🟢 Airflow

--- FAIL: kuttl (2639.64s)
    --- FAIL: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/smoke_airflow-2.9.2_openshift-false_executor-celery (461.41s)
        --- PASS: kuttl/harness/ldap_airflow-latest-2.8.1_ldap-authentication-insecure-tls_openshift-false_executor-celery (466.72s)
        --- PASS: kuttl/harness/resources_airflow-latest-2.8.1_openshift-false (214.12s)
        --- PASS: kuttl/harness/ldap_airflow-latest-2.8.1_ldap-authentication-server-verification-tls_openshift-false_executor-celery (351.50s)
        --- PASS: kuttl/harness/ldap_airflow-latest-2.8.1_ldap-authentication-server-verification-tls_openshift-false_executor-kubernetes (184.28s)
        --- FAIL: kuttl/harness/orphaned-resources_airflow-latest-2.8.1_openshift-false (452.91s)
        --- PASS: kuttl/harness/mount-dags-configmap_airflow-latest-2.8.1_openshift-false_executor-kubernetes (149.30s)
        --- PASS: kuttl/harness/mount-dags-gitsync_airflow-latest-2.8.1_openshift-false_executor-kubernetes (322.54s)
        --- PASS: kuttl/harness/mount-dags-gitsync_airflow-latest-2.8.1_openshift-false_executor-celery (312.49s)
        --- PASS: kuttl/harness/ldap_airflow-latest-2.8.1_ldap-authentication-no-tls_openshift-false_executor-celery (220.39s)
        --- PASS: kuttl/harness/cluster-operation_airflow-latest-2.8.1_openshift-false (268.85s)
        --- PASS: kuttl/harness/ldap_airflow-latest-2.8.1_ldap-authentication-no-tls_openshift-false_executor-kubernetes (176.17s)
        --- PASS: kuttl/harness/mount-dags-configmap_airflow-latest-2.8.1_openshift-false_executor-celery (192.76s)
        --- FAIL: kuttl/harness/logging_airflow-2.9.2_openshift-false_executor-kubernetes (561.36s)
        --- PASS: kuttl/harness/logging_airflow-2.9.2_openshift-false_executor-celery (407.26s)
        --- PASS: kuttl/harness/smoke_airflow-2.9.2_openshift-false_executor-kubernetes (218.22s)
        --- PASS: kuttl/harness/ldap_airflow-latest-2.8.1_ldap-authentication-insecure-tls_openshift-false_executor-kubernetes (184.08s)

I reran just:

./scripts/run-tests --test logging_airflow-2.9.2_openshift-false_executor-kubernetes
    logger.go:42: 15:52:03 | logging_airflow-2.9.2_openshift-false_executor-kubernetes/10-install-redis |     REDISCLI_AUTH="$REDIS_PASSWORD" redis-cli -h 127.0.0.1 -p 6379
[controller-runtime] log.SetLogger(...) was never called; logs will not be displayed.
Detected at:
    >  goroutine 37 [running]:
    >  runtime/debug.Stack()
    >   runtime/debug/stack.go:24 +0x5e
    >  sigs.k8s.io/controller-runtime/pkg/log.eventuallyFulfillRoot()
    >   sigs.k8s.io/controller-runtime@v0.16.3/pkg/log/log.go:60 +0xcd
    >  sigs.k8s.io/controller-runtime/pkg/log.(*delegatingLogSink).WithName(0xc000307c00, {0x1858f7f, 0x14})
    >   sigs.k8s.io/controller-runtime@v0.16.3/pkg/log/deleg.go:147 +0x3e
    >  github.com/go-logr/logr.Logger.WithName({{0x1adbab8, 0xc000307c00}, 0x0}, {0x1858f7f?, 0xc0005b1f80?})
    >   github.com/go-logr/logr@v1.2.4/logr.go:336 +0x36
    >  sigs.k8s.io/controller-runtime/pkg/client.newClient(0x1329f53?, {0x0, 0xc00048cb60, {0x1add0d0, 0xc00052f900}, 0x0, {0x0, 0x0}, 0x0})
    >   sigs.k8s.io/controller-runtime@v0.16.3/pkg/client/client.go:122 +0xf1
    >  sigs.k8s.io/controller-runtime/pkg/client.New(0xc0001f9208?, {0x0, 0xc00048cb60, {0x1add0d0, 0xc00052f900}, 0x0, {0x0, 0x0}, 0x0})
    >   sigs.k8s.io/controller-runtime@v0.16.3/pkg/client/client.go:103 +0x7d
    >  github.com/kudobuilder/kuttl/pkg/test/utils.NewRetryClient(0xc0001f9208, {0x0, 0xc00048cb60, {0x1add0d0, 0xc00052f900}, 0x0, {0x0, 0x0}, 0x0})
    >   github.com/kudobuilder/kuttl/pkg/test/utils/kubernetes.go:177 +0x127
    >  github.com/kudobuilder/kuttl/pkg/test.(*Harness).Client(0xc0004e0308, 0x95?)
    >   github.com/kudobuilder/kuttl/pkg/test/harness.go:323 +0x18e
    >  github.com/kudobuilder/kuttl/pkg/test.(*Step).Create(0xc00023b1e0, 0xc0004664e0, {0xc0004859b0, 0x14})
    >   github.com/kudobuilder/kuttl/pkg/test/step.go:177 +0x63
    >  github.com/kudobuilder/kuttl/pkg/test.(*Step).Run(0xc00023b1e0, 0xc0004664e0, {0xc0004859b0, 0x14})
    >   github.com/kudobuilder/kuttl/pkg/test/step.go:457 +0x24a
    >  github.com/kudobuilder/kuttl/pkg/test.(*Case).Run(0xc0002ae320, 0xc0004664e0, 0xc0002c38f0)
    >   github.com/kudobuilder/kuttl/pkg/test/case.go:362 +0x825
    >  github.com/kudobuilder/kuttl/pkg/test.(*Harness).RunTests.func1.1(0xc0004664e0)
    >   github.com/kudobuilder/kuttl/pkg/test/harness.go:401 +0x1b8
    >  testing.tRunner(0xc0004664e0, 0xc0004229c0)
    >   testing/testing.go:1689 +0xfb
    >  created by testing.(*T).Run in goroutine 36
    >   testing/testing.go:1742 +0x390
...
=== NAME  kuttl/harness/logging_airflow-2.9.2_openshift-false_executor-kubernetes
    logger.go:42: 15:25:39 | logging_airflow-2.9.2_openshift-false_executor-kubernetes/52-metrics | ConnectionError: (MaxRetryError("HTTPConnectionPool(host='airflow-scheduler-automatic-log-config', port=9102): Max retries exceeded with url: /metrics (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f61ff76c710>: Failed to establish a new connection: [Errno 111] Connection refused'))"),)

I re-ran it again, and is passed (but the Python error still exists. Could be a flakey test).

I then ran the other test and it was successful.

./scripts/run-tests --test orphaned-resources_airflow-latest-2.8.1_openshift-false 
Techassi commented 1 month ago

🟢 HDFS

--- PASS: kuttl (1970.27s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/profiling_hadoop-3.4.0_zookeeper-latest-3.9.2_openshift-false (195.08s)
        --- PASS: kuttl/harness/cluster-operation_hadoop-latest-3.3.6_zookeeper-latest-3.9.2_openshift-false (150.23s)
        --- PASS: kuttl/harness/kerberos_hadoop-latest-3.3.6_zookeeper-latest-3.9.2_krb5-1.21.1_kerberos-realm-PROD.MYCORP_kerberos-backend-mit_openshift-false (1066.03s)
        --- PASS: kuttl/harness/kerberos_hadoop-latest-3.3.6_zookeeper-latest-3.9.2_krb5-1.21.1_kerberos-realm-CLUSTER.LOCAL_kerberos-backend-mit_openshift-false (882.17s)
        --- PASS: kuttl/harness/logging_hadoop-3.4.0_zookeeper-latest-3.9.2_openshift-false (281.25s)
        --- PASS: kuttl/harness/topology-provider_hadoop-latest-3.3.6_zookeeper-latest-3.9.2_krb5-1.21.1_kerberos-backend-mit_openshift-false (165.82s)
        --- PASS: kuttl/harness/smoke_hadoop-3.4.0_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-2_datanode-pvcs-2hdd-1ssd_listener-class-external-unstable_openshift-false (107.61s)
        --- PASS: kuttl/harness/orphaned-resources_hadoop-latest-3.3.6_zookeeper-latest-3.9.2_openshift-false (83.63s)
        --- PASS: kuttl/harness/smoke_hadoop-3.4.0_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-2_datanode-pvcs-2hdd-1ssd_listener-class-cluster-internal_openshift-false (515.36s)
PASS
Techassi commented 1 month ago

🟢 Hive

--- PASS: kuttl (494.43s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/orphaned-resources_hive-latest-3.1.3_openshift-false (74.05s)
        --- PASS: kuttl/harness/cluster-operation_hive-latest-3.1.3_openshift-false (105.01s)
        --- PASS: kuttl/harness/resources_hive-3.1.3_openshift-false (31.60s)
        --- PASS: kuttl/harness/smoke_postgres-12.5.6_hive-3.1.3_openshift-false_s3-use-tls-true (119.84s)
        --- PASS: kuttl/harness/kerberos-s3_postgres-12.5.6_hive-3.1.3_krb5-1.21.1_openshift-false_s3-use-tls-true_kerberos-realm-PROD.MYCORP_kerberos-backend-mit (122.01s)
        --- PASS: kuttl/harness/logging_postgres-12.5.6_hive-3.1.3_openshift-false (50.74s)
        --- PASS: kuttl/harness/kerberos-hdfs_postgres-12.5.6_hive-3.1.3_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_krb5-1.21.1_openshift-false_kerberos-realm-PROD.MYCORP_kerberos-backend-mit (266.76s)
PASS
Maleware commented 1 month ago

🔴 Airflow ARM64

--- FAIL: kuttl (3989.76s)
    --- FAIL: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/smoke_airflow-2.9.2_openshift-false_executor-kubernetes (258.03s)
        --- PASS: kuttl/harness/orphaned-resources_airflow-latest-2.8.1_openshift-false (296.62s)
        --- PASS: kuttl/harness/smoke_airflow-2.6.3_openshift-false_executor-celery (269.73s)
        --- PASS: kuttl/harness/smoke_airflow-2.9.2_openshift-false_executor-celery (245.25s)
        --- PASS: kuttl/harness/smoke_airflow-2.8.4_openshift-false_executor-kubernetes (253.17s)
        --- PASS: kuttl/harness/smoke_airflow-2.8.4_openshift-false_executor-celery (240.03s)
        --- PASS: kuttl/harness/smoke_airflow-2.8.1_openshift-false_executor-kubernetes (199.09s)
        --- PASS: kuttl/harness/smoke_airflow-2.8.1_openshift-false_executor-celery (241.81s)
        --- PASS: kuttl/harness/smoke_airflow-2.6.3_openshift-false_executor-kubernetes (213.03s)
        --- PASS: kuttl/harness/logging_airflow-2.9.2_openshift-false_executor-kubernetes (376.39s)
        --- FAIL: kuttl/harness/logging_airflow-2.6.3_openshift-false_executor-kubernetes (711.57s)
        --- PASS: kuttl/harness/logging_airflow-2.9.2_openshift-false_executor-celery (291.92s)
        --- PASS: kuttl/harness/logging_airflow-2.8.4_openshift-false_executor-celery (299.56s)
        --- FAIL: kuttl/harness/logging_airflow-2.8.4_openshift-false_executor-kubernetes (516.79s)
        --- PASS: kuttl/harness/logging_airflow-2.8.1_openshift-false_executor-celery (352.66s)
        --- FAIL: kuttl/harness/logging_airflow-2.8.1_openshift-false_executor-kubernetes (518.86s)
        --- PASS: kuttl/harness/ldap_airflow-latest-2.8.1_ldap-authentication-no-tls_openshift-false_executor-kubernetes (176.21s)
        --- PASS: kuttl/harness/ldap_airflow-latest-2.8.1_ldap-authentication-server-verification-tls_openshift-false_executor-kubernetes (174.72s)
        --- PASS: kuttl/harness/ldap_airflow-latest-2.8.1_ldap-authentication-server-verification-tls_openshift-false_executor-celery (205.65s)
        --- PASS: kuttl/harness/ldap_airflow-latest-2.8.1_ldap-authentication-insecure-tls_openshift-false_executor-kubernetes (166.75s)
        --- PASS: kuttl/harness/ldap_airflow-latest-2.8.1_ldap-authentication-no-tls_openshift-false_executor-celery (200.53s)
        --- PASS: kuttl/harness/ldap_airflow-latest-2.8.1_ldap-authentication-insecure-tls_openshift-false_executor-celery (199.32s)
        --- PASS: kuttl/harness/mount-dags-gitsync_airflow-latest-2.8.1_openshift-false_executor-kubernetes (210.44s)
        --- PASS: kuttl/harness/logging_airflow-2.6.3_openshift-false_executor-celery (285.19s)
        --- PASS: kuttl/harness/cluster-operation_airflow-latest-2.8.1_openshift-false (283.52s)
        --- PASS: kuttl/harness/resources_airflow-latest-2.8.1_openshift-false (198.99s)
        --- PASS: kuttl/harness/mount-dags-configmap_airflow-latest-2.8.1_openshift-false_executor-kubernetes (139.67s)
        --- PASS: kuttl/harness/mount-dags-gitsync_airflow-latest-2.8.1_openshift-false_executor-celery (209.87s)
        --- PASS: kuttl/harness/mount-dags-configmap_airflow-latest-2.8.1_openshift-false_executor-celery (168.96s)

Rerun worked for all but ./scripts/run_tests.sh --test=logging_airflow-2.8.1_openshift-false_executor-kubernetes with

--- FAIL: kuttl (674.36s)
    --- FAIL: kuttl/harness (0.00s)
        --- FAIL: kuttl/harness/logging_airflow-2.8.1_openshift-false_executor-kubernetes (674.34s)

with error

logging_airflow-2.8.1_openshift-false_executor-kubernetes/52-metrics | ConnectionError: (MaxRetryError("HTTPConnectionPool(host='airflow-scheduler-automatic-log-config', port=9102): Max retries exceeded with url: /metrics (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0xffffa0370c20>: Failed to establish a new connection: [Errno 111] Connection refused'))"),)

Same as @NickLarsenNZ

Maleware commented 1 month ago

🟢 Kafka ARM64

Results:

--- FAIL: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/cluster-operation_kafka-latest-3.7.1_zookeeper-latest-3.9.2_openshift-false (82.37s)
        --- FAIL: kuttl/harness/upgrade_zookeeper-3.9.2_upgrade_old-3.6.1_upgrade_new-3.7.1_use-client-tls-true_use-client-auth-tls-false_openshift-false (371.34s)
        --- FAIL: kuttl/harness/upgrade_zookeeper-3.9.2_upgrade_old-3.6.1_upgrade_new-3.7.1_use-client-tls-true_use-client-auth-tls-true_openshift-false (356.45s)
        --- PASS: kuttl/harness/tls_kafka-3.4.1_zookeeper-latest-3.9.2_use-client-tls-true_use-client-auth-tls-false_openshift-false (137.56s)
        --- FAIL: kuttl/harness/upgrade_zookeeper-3.9.2_upgrade_old-3.6.1_upgrade_new-3.7.1_use-client-tls-false_use-client-auth-tls-true_openshift-false (346.22s)
        --- FAIL: kuttl/harness/upgrade_zookeeper-3.9.2_upgrade_old-3.6.1_upgrade_new-3.7.1_use-client-tls-false_use-client-auth-tls-false_openshift-false (350.40s)
        --- FAIL: kuttl/harness/upgrade_zookeeper-3.9.2_upgrade_old-3.4.1_upgrade_new-3.7.1_use-client-tls-true_use-client-auth-tls-true_openshift-false (358.03s)
        --- FAIL: kuttl/harness/upgrade_zookeeper-3.9.2_upgrade_old-3.4.1_upgrade_new-3.7.1_use-client-tls-true_use-client-auth-tls-false_openshift-false (352.82s)
        --- FAIL: kuttl/harness/upgrade_zookeeper-3.9.2_upgrade_old-3.4.1_upgrade_new-3.7.1_use-client-tls-false_use-client-auth-tls-true_openshift-false (354.83s)
        --- FAIL: kuttl/harness/upgrade_zookeeper-3.9.2_upgrade_old-3.4.1_upgrade_new-3.7.1_use-client-tls-false_use-client-auth-tls-false_openshift-false (350.22s)
        --- PASS: kuttl/harness/tls_kafka-3.7.1_zookeeper-latest-3.9.2_use-client-tls-true_use-client-auth-tls-true_openshift-false (150.41s)
        --- PASS: kuttl/harness/tls_kafka-3.6.2_zookeeper-latest-3.9.2_use-client-tls-false_use-client-auth-tls-false_openshift-false (247.12s)
        --- PASS: kuttl/harness/tls_kafka-3.6.1_zookeeper-latest-3.9.2_use-client-tls-true_use-client-auth-tls-true_openshift-false (132.62s)
        --- FAIL: kuttl/harness/tls_kafka-3.6.1_zookeeper-latest-3.9.2_use-client-tls-true_use-client-auth-tls-false_openshift-false (425.91s)
        --- PASS: kuttl/harness/tls_kafka-3.6.1_zookeeper-latest-3.9.2_use-client-tls-false_use-client-auth-tls-true_openshift-false (134.40s)
        --- PASS: kuttl/harness/tls_kafka-3.6.1_zookeeper-latest-3.9.2_use-client-tls-false_use-client-auth-tls-false_openshift-false (207.08s)
        --- PASS: kuttl/harness/tls_kafka-3.4.1_zookeeper-latest-3.9.2_use-client-tls-true_use-client-auth-tls-true_openshift-false (300.00s)
        --- PASS: kuttl/harness/smoke_kafka-3.4.1_zookeeper-3.9.2_use-client-tls-false_openshift-false (57.89s)
        --- PASS: kuttl/harness/tls_kafka-3.4.1_zookeeper-latest-3.9.2_use-client-tls-false_use-client-auth-tls-true_openshift-false (139.63s)
        --- FAIL: kuttl/harness/tls_kafka-3.4.1_zookeeper-latest-3.9.2_use-client-tls-false_use-client-auth-tls-false_openshift-false (337.94s)
        --- PASS: kuttl/harness/smoke_kafka-3.7.1_zookeeper-3.9.2_use-client-tls-true_openshift-false (59.99s)
        --- PASS: kuttl/harness/smoke_kafka-3.7.1_zookeeper-3.9.2_use-client-tls-false_openshift-false (52.77s)
        --- PASS: kuttl/harness/smoke_kafka-3.6.2_zookeeper-3.9.2_use-client-tls-true_openshift-false (61.96s)
        --- PASS: kuttl/harness/smoke_kafka-3.6.2_zookeeper-3.9.2_use-client-tls-false_openshift-false (58.89s)
        --- PASS: kuttl/harness/smoke_kafka-3.6.1_zookeeper-3.9.2_use-client-tls-true_openshift-false (56.77s)
        --- PASS: kuttl/harness/smoke_kafka-3.6.1_zookeeper-3.9.2_use-client-tls-false_openshift-false (54.50s)
        --- PASS: kuttl/harness/smoke_kafka-3.4.1_zookeeper-3.9.2_use-client-tls-true_openshift-false (60.74s)
        --- PASS: kuttl/harness/tls_kafka-3.6.2_zookeeper-latest-3.9.2_use-client-tls-false_use-client-auth-tls-true_openshift-false (140.40s)
        --- PASS: kuttl/harness/delete-rolegroup_kafka-3.4.1_zookeeper-latest-3.9.2_openshift-false (50.94s)
        --- PASS: kuttl/harness/tls_kafka-3.7.1_zookeeper-latest-3.9.2_use-client-tls-true_use-client-auth-tls-false_openshift-false (143.25s)
        --- PASS: kuttl/harness/configuration_kafka-latest-3.7.1_zookeeper-latest-3.9.2_openshift-false (26.49s)
        --- PASS: kuttl/harness/tls_kafka-3.7.1_zookeeper-latest-3.9.2_use-client-tls-false_use-client-auth-tls-true_openshift-false (150.64s)
        --- PASS: kuttl/harness/delete-rolegroup_kafka-3.7.1_zookeeper-latest-3.9.2_openshift-false (48.98s)
        --- PASS: kuttl/harness/tls_kafka-3.7.1_zookeeper-latest-3.9.2_use-client-tls-false_use-client-auth-tls-false_openshift-false (298.30s)
        --- PASS: kuttl/harness/delete-rolegroup_kafka-3.6.2_zookeeper-latest-3.9.2_openshift-false (46.02s)
        --- PASS: kuttl/harness/tls_kafka-3.6.2_zookeeper-latest-3.9.2_use-client-tls-true_use-client-auth-tls-true_openshift-false (253.95s)
        --- PASS: kuttl/harness/delete-rolegroup_kafka-3.6.1_zookeeper-latest-3.9.2_openshift-false (42.91s)
        --- FAIL: kuttl/harness/tls_kafka-3.6.2_zookeeper-latest-3.9.2_use-client-tls-true_use-client-auth-tls-false_openshift-false (419.78s)
        --- PASS: kuttl/harness/logging_kafka-3.6.2_zookeeper-latest-3.9.2_openshift-false (137.33s)
        --- PASS: kuttl/harness/logging_kafka-3.7.1_zookeeper-latest-3.9.2_openshift-false (299.92s)
        --- PASS: kuttl/harness/logging_kafka-3.6.1_zookeeper-latest-3.9.2_openshift-false (300.01s)
        --- PASS: kuttl/harness/logging_kafka-3.4.1_zookeeper-latest-3.9.2_openshift-false (300.04s)
FAIL
ERROR:root:kuttl failed

The upgrade-zookeeper Jobs fail with

` case.go:401: resource StatefulSet:kuttl-test-elegant-goose/test-kafka-broker-default: .metadata.labels.app.kubernetes.io/version: value mismatch, expected: 3.7.1-stackable0.0.0-dev != actual: 3.7.1-stackable24.7.0`

which comes from https://github.com/stackabletech/kafka-operator/blob/main/tests/templates/kuttl/upgrade/04-assert.yaml.j2#L11 and can be explained with the 0.0.0-dev version hardcoded in the assert. Fix: https://github.com/stackabletech/kafka-operator/pull/737

The TLS tests went green after rerunning them.

--- PASS: kuttl (151.91s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/tls_kafka-3.6.1_zookeeper-latest-3.9.2_use-client-tls-true_use-client-auth-tls-false_openshift-false (151.89s)
PASS
--- PASS: kuttl (240.16s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/tls_kafka-3.4.1_zookeeper-latest-3.9.2_use-client-tls-false_use-client-auth-tls-false_openshift-false (240.13s)
PASS
--- PASS: kuttl (335.20s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/tls_kafka-3.6.2_zookeeper-latest-3.9.2_use-client-tls-true_use-client-auth-tls-false_openshift-false (335.15s)
PASS
Maleware commented 1 month ago

🟢 Secret ARM

--- PASS: kuttl (116.33s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/tls_openshift-false (27.73s)
        --- PASS: kuttl/harness/kerberos_krb5-1.21.1_openshift-false (54.01s)
        --- PASS: kuttl/harness/listener_openshift-false (34.57s)
PASS
Maleware commented 1 month ago

🟢 Zookeeper ARM

--- PASS: kuttl (1050.57s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/cluster-operation_zookeeper-latest-3.9.2_openshift-false (37.91s)
        --- PASS: kuttl/harness/znode_zookeeper-latest-3.9.2_openshift-false (26.75s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.8.4_use-server-tls-true_use-client-auth-tls-false_openshift-false (136.40s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.9.2_use-server-tls-true_use-client-auth-tls-true_openshift-false (115.27s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.9.2_use-server-tls-true_use-client-auth-tls-false_openshift-false (74.76s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.9.2_use-server-tls-false_use-client-auth-tls-true_openshift-false (74.88s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.9.2_use-server-tls-false_use-client-auth-tls-false_openshift-false (52.05s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.8.4_use-server-tls-true_use-client-auth-tls-true_openshift-false (113.44s)
        --- PASS: kuttl/harness/delete-rolegroup_zookeeper-3.9.2_openshift-false (75.44s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.8.4_use-server-tls-false_use-client-auth-tls-true_openshift-false (77.98s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.8.4_use-server-tls-false_use-client-auth-tls-false_openshift-false (54.13s)
        --- PASS: kuttl/harness/logging_zookeeper-3.9.2_openshift-false (57.79s)
        --- PASS: kuttl/harness/delete-rolegroup_zookeeper-3.8.4_openshift-false (97.25s)
        --- PASS: kuttl/harness/logging_zookeeper-3.8.4_openshift-false (56.50s)
PASS
Maleware commented 1 month ago

🟢 Opa ARM

--- PASS: kuttl (488.22s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/logging_opa-0.61.0_openshift-false (68.99s)
        --- PASS: kuttl/harness/keycloak-user-info_opa-latest-0.66.0_keycloak-23.0.1_openshift-false (118.49s)
        --- PASS: kuttl/harness/smoke_opa-0.66.0_openshift-false (55.62s)
        --- PASS: kuttl/harness/smoke_opa-0.61.0_openshift-false (56.50s)
        --- PASS: kuttl/harness/aas-user-info_opa-latest-0.66.0_openshift-false (73.09s)
        --- PASS: kuttl/harness/cluster-operation_opa-latest-0.66.0_openshift-false (28.28s)
        --- PASS: kuttl/harness/resources_opa-latest-0.66.0_openshift-false (18.23s)
        --- PASS: kuttl/harness/logging_opa-0.66.0_openshift-false (68.99s)
PASS
Techassi commented 1 month ago

🟢 Kafka

--- PASS: kuttl (571.52s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/logging_kafka-3.7.1_zookeeper-latest-3.9.2_openshift-false (121.02s)
        --- PASS: kuttl/harness/tls_kafka-3.7.1_zookeeper-latest-3.9.2_use-client-tls-true_use-client-auth-tls-true_openshift-false (164.54s)
        --- PASS: kuttl/harness/tls_kafka-3.7.1_zookeeper-latest-3.9.2_use-client-tls-true_use-client-auth-tls-false_openshift-false (121.22s)
        --- PASS: kuttl/harness/tls_kafka-3.7.1_zookeeper-latest-3.9.2_use-client-tls-false_use-client-auth-tls-true_openshift-false (124.27s)
        --- PASS: kuttl/harness/tls_kafka-3.7.1_zookeeper-latest-3.9.2_use-client-tls-false_use-client-auth-tls-false_openshift-false (50.70s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.9.2_upgrade_old-3.6.1_upgrade_new-3.7.1_use-client-tls-false_use-client-auth-tls-true_openshift-false (97.92s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.9.2_upgrade_old-3.6.1_upgrade_new-3.7.1_use-client-tls-true_use-client-auth-tls-true_openshift-false (94.97s)
        --- PASS: kuttl/harness/cluster-operation_kafka-latest-3.7.1_zookeeper-latest-3.9.2_openshift-false (58.85s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.9.2_upgrade_old-3.6.1_upgrade_new-3.7.1_use-client-tls-true_use-client-auth-tls-false_openshift-false (65.65s)
        --- PASS: kuttl/harness/smoke_kafka-3.7.1_zookeeper-3.9.2_use-client-tls-false_openshift-false (32.93s)
        --- PASS: kuttl/harness/smoke_kafka-3.7.1_zookeeper-3.9.2_use-client-tls-true_openshift-false (39.92s)
        --- PASS: kuttl/harness/delete-rolegroup_kafka-3.7.1_zookeeper-latest-3.9.2_openshift-false (42.60s)
        --- PASS: kuttl/harness/configuration_kafka-latest-3.7.1_zookeeper-latest-3.9.2_openshift-false (14.19s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.9.2_upgrade_old-3.6.1_upgrade_new-3.7.1_use-client-tls-false_use-client-auth-tls-false_openshift-false (84.83s)
PASS
Maleware commented 1 month ago

🟢 HDFS ARM

--- PASS: kuttl (7725.17s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/logging_hadoop-3.3.4_zookeeper-latest-3.9.2_openshift-false (314.58s)
        --- PASS: kuttl/harness/smoke_hadoop-3.3.6_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-1_datanode-pvcs-default_listener-class-cluster-internal_openshift-false (113.79s)
        --- PASS: kuttl/harness/profiling_hadoop-3.4.0_zookeeper-latest-3.9.2_openshift-false (120.74s)
        --- PASS: kuttl/harness/profiling_hadoop-3.3.6_zookeeper-latest-3.9.2_openshift-false (117.71s)
        --- PASS: kuttl/harness/profiling_hadoop-3.3.4_zookeeper-latest-3.9.2_openshift-false (117.74s)
        --- PASS: kuttl/harness/smoke_hadoop-3.4.0_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-2_datanode-pvcs-default_listener-class-external-unstable_openshift-false (135.99s)
        --- PASS: kuttl/harness/smoke_hadoop-3.4.0_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-2_datanode-pvcs-default_listener-class-cluster-internal_openshift-false (135.80s)
        --- PASS: kuttl/harness/smoke_hadoop-3.4.0_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-2_datanode-pvcs-2hdd-1ssd_listener-class-external-unstable_openshift-false (137.40s)
        --- PASS: kuttl/harness/smoke_hadoop-3.4.0_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-2_datanode-pvcs-2hdd-1ssd_listener-class-cluster-internal_openshift-false (567.67s)
        --- PASS: kuttl/harness/smoke_hadoop-3.4.0_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-1_datanode-pvcs-default_listener-class-external-unstable_openshift-false (116.35s)
        --- PASS: kuttl/harness/smoke_hadoop-3.4.0_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-1_datanode-pvcs-default_listener-class-cluster-internal_openshift-false (111.31s)
        --- PASS: kuttl/harness/smoke_hadoop-3.4.0_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-1_datanode-pvcs-2hdd-1ssd_listener-class-external-unstable_openshift-false (125.56s)
        --- PASS: kuttl/harness/smoke_hadoop-3.4.0_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-1_datanode-pvcs-2hdd-1ssd_listener-class-cluster-internal_openshift-false (108.63s)
        --- PASS: kuttl/harness/smoke_hadoop-3.3.6_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-2_datanode-pvcs-default_listener-class-external-unstable_openshift-false (133.46s)
        --- PASS: kuttl/harness/smoke_hadoop-3.3.6_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-2_datanode-pvcs-default_listener-class-cluster-internal_openshift-false (134.87s)
        --- PASS: kuttl/harness/smoke_hadoop-3.3.6_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-2_datanode-pvcs-2hdd-1ssd_listener-class-external-unstable_openshift-false (138.00s)
        --- PASS: kuttl/harness/smoke_hadoop-3.3.6_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-2_datanode-pvcs-2hdd-1ssd_listener-class-cluster-internal_openshift-false (545.04s)
        --- PASS: kuttl/harness/smoke_hadoop-3.3.6_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-1_datanode-pvcs-default_listener-class-external-unstable_openshift-false (124.52s)
        --- PASS: kuttl/harness/smoke_hadoop-3.3.4_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-1_datanode-pvcs-2hdd-1ssd_listener-class-external-unstable_openshift-false (114.67s)
        --- PASS: kuttl/harness/smoke_hadoop-3.3.6_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-1_datanode-pvcs-2hdd-1ssd_listener-class-external-unstable_openshift-false (111.06s)
        --- PASS: kuttl/harness/smoke_hadoop-3.3.6_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-1_datanode-pvcs-2hdd-1ssd_listener-class-cluster-internal_openshift-false (121.78s)
        --- PASS: kuttl/harness/smoke_hadoop-3.3.4_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-2_datanode-pvcs-default_listener-class-external-unstable_openshift-false (137.93s)
        --- PASS: kuttl/harness/smoke_hadoop-3.3.4_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-2_datanode-pvcs-default_listener-class-cluster-internal_openshift-false (138.64s)
        --- PASS: kuttl/harness/smoke_hadoop-3.3.4_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-2_datanode-pvcs-2hdd-1ssd_listener-class-external-unstable_openshift-false (135.45s)
        --- PASS: kuttl/harness/smoke_hadoop-3.3.4_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-2_datanode-pvcs-2hdd-1ssd_listener-class-cluster-internal_openshift-false (535.37s)
        --- PASS: kuttl/harness/smoke_hadoop-3.3.4_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-1_datanode-pvcs-default_listener-class-external-unstable_openshift-false (111.14s)
        --- PASS: kuttl/harness/smoke_hadoop-3.3.4_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-1_datanode-pvcs-default_listener-class-cluster-internal_openshift-false (114.12s)
        --- PASS: kuttl/harness/kerberos_hadoop-latest-3.3.6_zookeeper-latest-3.9.2_krb5-1.21.1_kerberos-realm-PROD.MYCORP_kerberos-backend-mit_openshift-false (893.01s)
        --- PASS: kuttl/harness/smoke_hadoop-3.3.4_zookeeper-3.9.2_zookeeper-latest-3.9.2_number-of-datanodes-1_datanode-pvcs-2hdd-1ssd_listener-class-cluster-internal_openshift-false (115.12s)
        --- PASS: kuttl/harness/orphaned-resources_hadoop-latest-3.3.6_zookeeper-latest-3.9.2_openshift-false (98.63s)
        --- PASS: kuttl/harness/cluster-operation_hadoop-latest-3.3.6_zookeeper-latest-3.9.2_openshift-false (166.36s)
        --- PASS: kuttl/harness/topology-provider_hadoop-latest-3.3.6_zookeeper-latest-3.9.2_krb5-1.21.1_kerberos-backend-mit_openshift-false (182.80s)
        --- PASS: kuttl/harness/kerberos_hadoop-latest-3.3.6_zookeeper-latest-3.9.2_krb5-1.21.1_kerberos-realm-CLUSTER.LOCAL_kerberos-backend-mit_openshift-false (869.34s)
        --- PASS: kuttl/harness/logging_hadoop-3.4.0_zookeeper-latest-3.9.2_openshift-false (290.61s)
        --- PASS: kuttl/harness/logging_hadoop-3.3.6_zookeeper-latest-3.9.2_openshift-false (289.98s)
PASS
Techassi commented 1 month ago

🟢 Listener

--- PASS: kuttl (56.50s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/smoke-nodeport_openshift-false (56.47s)
PASS
NickLarsenNZ commented 1 month ago

🟢 Druid

Fixes:

Many failures ``` --- FAIL: kuttl (4666.10s) --- FAIL: kuttl/harness (0.00s) --- FAIL: kuttl/harness/authorizer_druid-28.0.1_zookeeper-latest-3.9.2_opa-0.66.0_hadoop-3.3.6_openshift-false (1165.50s) --- FAIL: kuttl/harness/tls_druid-latest-28.0.1_zookeeper-latest-3.9.2_tls-mode-internal-and-server-tls-and-tls-client-auth_openshift-false (1246.91s) --- FAIL: kuttl/harness/s3-deep-storage_druid-latest-28.0.1_zookeeper-latest-3.9.2_s3-use-tls-true_openshift-false (531.69s) --- FAIL: kuttl/harness/resources_druid-latest-28.0.1_zookeeper-latest-3.9.2_openshift-false (458.29s) --- PASS: kuttl/harness/ldap_druid-28.0.1_zookeeper-latest-3.9.2_opa-0.66.0_hadoop-latest-3.4.0_ldap-use-tls-true_ldap-no-bind-credentials-false_openshift-false (363.90s) --- FAIL: kuttl/harness/orphaned-resources_druid-latest-28.0.1_zookeeper-latest-3.9.2_hadoop-3.3.6_openshift-false (682.97s) --- FAIL: kuttl/harness/logging_druid-28.0.1_zookeeper-latest-3.9.2_hadoop-3.3.6_openshift-false (588.84s) --- FAIL: kuttl/harness/tls_druid-latest-28.0.1_zookeeper-latest-3.9.2_tls-mode-no-tls_openshift-false (523.68s) --- FAIL: kuttl/harness/tls_druid-latest-28.0.1_zookeeper-latest-3.9.2_tls-mode-internal-and-server-tls_openshift-false (521.77s) --- PASS: kuttl/harness/oidc_druid-28.0.1_zookeeper-latest-3.9.2_s3-use-tls-true_openshift-false_oidc-use-tls-true (317.00s) --- PASS: kuttl/harness/ingestion-no-s3-ext_druid-latest-28.0.1_zookeeper-latest-3.9.2_hadoop-3.3.6_openshift-false (343.26s) --- FAIL: kuttl/harness/hdfs-deep-storage_druid-latest-28.0.1_zookeeper-latest-3.9.2_hadoop-3.3.6_openshift-false (622.00s) --- FAIL: kuttl/harness/ingestion-s3-ext_druid-latest-28.0.1_zookeeper-latest-3.9.2_hadoop-3.3.6_openshift-false (587.01s) --- FAIL: kuttl/harness/cluster-operation_druid-latest-28.0.1_zookeeper-latest-3.9.2_hadoop-latest-3.4.0_openshift-false (631.75s) --- FAIL: kuttl/harness/smoke_druid-28.0.1_zookeeper-3.8.4_hadoop-3.3.6_openshift-false (556.10s) FAIL ERROR:root:kuttl failed ```

I re-ran each test individually, and with --skip-delete. Otherwise the test fails because deletion takes forever.

Techassi commented 1 month ago

🟢 NiFi

Some tests were marked as `PASS` even when the `Job` pods had not run yet (or were failing). Test should wait on jobs to finish successfully. ```shell ./scripts/run-tests --test "orphaned_resources_zookeeper-latest-3.9.2_nifi-2.0.0-M4_openshift-false" --skip-delete # Exception: Failed to retrieve ReportingTask[StackablePrometheusReportingTask/8081]: (409) # Reason: Conflict # HTTP response headers: HTTPHeaderDict({'Date': 'Mon, 29 Jul 2024 20:06:24 GMT', 'Set-Cookie': '__Secure-Request-Token=710b7670-d970-40a1-b0aa-37ccc5d0a506; Path=/; Domain=test-nifi-reporting-task.kuttl-test-poetic-piranha.svc.cluster.local; Secure; SameSite=Strict', 'Content-Type': 'text/plain', 'Vary': 'Accept-Encoding', 'Content-Encoding': 'gzip', 'Content-Security-Policy': "frame-ancestors 'self'", 'Strict-Transport-Security': 'max-age=31536000 ; includeSubDomains', 'X-Content-Type-Options': 'nosniff', 'X-Frame-Options': 'SAMEORIGIN', 'X-XSS-Protection': '0', 'Content-Length': '66'}) # HTTP response body: The Flow Controller is initializing the Data Flow. # Successfully authenticated and established connection with [https://test-nifi-reporting-task.kuttl-test-poetic-piranha.svc.cluster.local:8443/nifi-api] # Stream closed EOF for kuttl-test-poetic-piranha/test-nifi-create-reporting-task-2-0-0-m4-64b74 (reporting-task) # it finally completed ./scripts/run-tests --test "logging_zookeeper-latest-3.9.2_nifi-2.0.0-M4_openshift-false" --skip-delete # 2024-07-29 21:03:42,155 WARNING Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': /nifi-api/access/token # 2024-07-29 21:03:42,155 WARNING Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': /nifi-api/access/token # WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': /nifi-api/access/token # 2024-07-29 21:03:43,179 WARNING Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': /nifi-api/access/token # 2024-07-29 21:03:43,179 WARNING Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': /nifi-api/access/token # WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': /nifi-api/access/token # 2024-07-29 21:03:44,204 WARNING Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': /nifi-api/access/token # 2024-07-29 21:03:44,204 WARNING Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': /nifi-api/access/token # WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': /nifi-api/access/token # Exception: Failed to connect to https://test-nifi-reporting-task.kuttl-test-elegant-krill.svc.cluster.local:8443/nifi-api: HTTPSConnectionPool(host='test-nifi-reporting-task.kuttl-test-elegant-krill.svc.cluster.local', port=8443): Max retries exceeded with url: /nifi-api/access/token (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) # Stream closed EOF for kuttl-test-elegant-krill/test-nifi-create-reporting-task-2-0-0-m4-k5c6x (reporting-task) # it finally completes ```
Maleware commented 1 month ago

🟢 Druid ARM

--- FAIL: kuttl (9084.45s)
    --- FAIL: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/ingestion-no-s3-ext_druid-latest-28.0.1_zookeeper-latest-3.9.2_hadoop-3.3.6_openshift-false (279.17s)
        --- PASS: kuttl/harness/logging_druid-28.0.1_zookeeper-latest-3.9.2_hadoop-3.3.6_openshift-false (210.62s)
        --- PASS: kuttl/harness/hdfs-deep-storage_druid-latest-28.0.1_zookeeper-latest-3.9.2_hadoop-3.3.6_openshift-false (258.83s)
        --- PASS: kuttl/harness/orphaned-resources_druid-latest-28.0.1_zookeeper-latest-3.9.2_hadoop-3.3.6_openshift-false (275.39s)
        --- FAIL: kuttl/harness/tls_druid-latest-28.0.1_zookeeper-latest-3.9.2_tls-mode-no-tls_openshift-false (496.34s)
        --- PASS: kuttl/harness/logging_druid-26.0.0_zookeeper-latest-3.9.2_hadoop-3.3.6_openshift-false (207.91s)
        --- PASS: kuttl/harness/ingestion-s3-ext_druid-latest-28.0.1_zookeeper-latest-3.9.2_hadoop-3.3.6_openshift-false (263.78s)
        --- PASS: kuttl/harness/oidc_druid-28.0.1_zookeeper-latest-3.9.2_s3-use-tls-true_openshift-false_oidc-use-tls-true (219.58s)
        --- PASS: kuttl/harness/oidc_druid-28.0.1_zookeeper-latest-3.9.2_s3-use-tls-true_openshift-false_oidc-use-tls-false (364.11s)
        --- PASS: kuttl/harness/oidc_druid-28.0.1_zookeeper-latest-3.9.2_s3-use-tls-false_openshift-false_oidc-use-tls-true (192.88s)
        --- PASS: kuttl/harness/oidc_druid-28.0.1_zookeeper-latest-3.9.2_s3-use-tls-false_openshift-false_oidc-use-tls-false (260.00s)
        --- PASS: kuttl/harness/oidc_druid-26.0.0_zookeeper-latest-3.9.2_s3-use-tls-true_openshift-false_oidc-use-tls-true (252.45s)
        --- PASS: kuttl/harness/oidc_druid-26.0.0_zookeeper-latest-3.9.2_s3-use-tls-true_openshift-false_oidc-use-tls-false (237.13s)
        --- PASS: kuttl/harness/oidc_druid-26.0.0_zookeeper-latest-3.9.2_s3-use-tls-false_openshift-false_oidc-use-tls-true (261.49s)
        --- PASS: kuttl/harness/oidc_druid-26.0.0_zookeeper-latest-3.9.2_s3-use-tls-false_openshift-false_oidc-use-tls-false (203.53s)
        --- PASS: kuttl/harness/smoke_druid-28.0.1_zookeeper-3.8.4_hadoop-3.3.6_openshift-false (205.91s)
        --- FAIL: kuttl/harness/smoke_druid-26.0.0_zookeeper-3.8.4_hadoop-3.3.6_openshift-false (490.21s)
        --- FAIL: kuttl/harness/s3-deep-storage_druid-latest-28.0.1_zookeeper-latest-3.9.2_s3-use-tls-false_openshift-false (502.93s)
        --- FAIL: kuttl/harness/tls_druid-latest-28.0.1_zookeeper-latest-3.9.2_tls-mode-internal-and-server-tls_openshift-false (516.63s)
        --- FAIL: kuttl/harness/tls_druid-latest-28.0.1_zookeeper-latest-3.9.2_tls-mode-internal-and-server-tls-and-tls-client-auth_openshift-false (693.17s)
        --- PASS: kuttl/harness/authorizer_druid-28.0.1_zookeeper-latest-3.9.2_opa-0.66.0_hadoop-3.3.6_openshift-false (174.22s)
        --- PASS: kuttl/harness/authorizer_druid-26.0.0_zookeeper-latest-3.9.2_opa-0.66.0_hadoop-3.3.6_openshift-false (205.26s)
        --- FAIL: kuttl/harness/s3-deep-storage_druid-latest-28.0.1_zookeeper-latest-3.9.2_s3-use-tls-true_openshift-false (497.36s)
        --- PASS: kuttl/harness/ldap_druid-28.0.1_zookeeper-latest-3.9.2_opa-0.66.0_hadoop-latest-3.4.0_ldap-use-tls-false_ldap-no-bind-credentials-false_openshift-false (209.53s)
        --- FAIL: kuttl/harness/cluster-operation_druid-latest-28.0.1_zookeeper-latest-3.9.2_hadoop-latest-3.4.0_openshift-false (569.73s)
        --- PASS: kuttl/harness/ldap_druid-28.0.1_zookeeper-latest-3.9.2_opa-0.66.0_hadoop-latest-3.4.0_ldap-use-tls-true_ldap-no-bind-credentials-false_openshift-false (218.96s)
        --- PASS: kuttl/harness/ldap_druid-26.0.0_zookeeper-latest-3.9.2_opa-0.66.0_hadoop-latest-3.4.0_ldap-use-tls-false_ldap-no-bind-credentials-false_openshift-false (186.85s)
        --- PASS: kuttl/harness/ldap_druid-26.0.0_zookeeper-latest-3.9.2_opa-0.66.0_hadoop-latest-3.4.0_ldap-use-tls-true_ldap-no-bind-credentials-false_openshift-false (202.67s)
        --- FAIL: kuttl/harness/resources_druid-latest-28.0.1_zookeeper-latest-3.9.2_openshift-false (427.79s)
FAIL
ERROR:root:kuttl failed

Rerun: ./scripts/run_tests.sh --test=tls_druid-latest-28.0.1_zookeeper-latest-3.9.2_tls-mode-no-tls_openshift-false

--- PASS: kuttl (257.55s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/tls_druid-latest-28.0.1_zookeeper-latest-3.9.2_tls-mode-no-tls_openshift-false (257.53s)
PASS

Rerun: ./scripts/run_tests.sh --test=smoke_druid-26.0.0_zookeeper-3.8.4_hadoop-3.3.6_openshift-false --skip-release

--- PASS: kuttl (208.74s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/smoke_druid-26.0.0_zookeeper-3.8.4_hadoop-3.3.6_openshift-false (208.70s)
PASS

Rerun: ./scripts/run_tests.sh --test=s3-deep-storage_druid-latest-28.0.1_zookeeper-latest-3.9.2_s3-use-tls-false_openshift-false --skip-release

--- PASS: kuttl (221.55s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/s3-deep-storage_druid-latest-28.0.1_zookeeper-latest-3.9.2_s3-use-tls-false_openshift-false (221.51s)
PASS

Rerun: ./scripts/run_tests.sh --test=tls_druid-latest-28.0.1_zookeeper-latest-3.9.2_tls-mode-internal-and-server-tls_openshift-false --skip-release

--- PASS: kuttl (417.18s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/tls_druid-latest-28.0.1_zookeeper-latest-3.9.2_tls-mode-internal-and-server-tls_openshift-false (417.14s)
PASS

Rerun twice: ./scripts/run_tests.sh --test=tls_druid-latest-28.0.1_zookeeper-latest-3.9.2_tls-mode-internal-and-server-tls-and-tls-client-auth_openshift-false --skip-release

--- PASS: kuttl (228.93s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/tls_druid-latest-28.0.1_zookeeper-latest-3.9.2_tls-mode-internal-and-server-tls-and-tls-client-auth_openshift-false (228.91s)
PASS

Rerun: ./scripts/run_tests.sh --test=s3-deep-storage_druid-latest-28.0.1_zookeeper-latest-3.9.2_s3-use-tls-true_openshift-false --skip-release

--- PASS: kuttl (577.70s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/s3-deep-storage_druid-latest-28.0.1_zookeeper-latest-3.9.2_s3-use-tls-true_openshift-false (577.66s)
PASS

Rerun: ./scripts/run_tests.sh --test=cluster-operation_druid-latest-28.0.1_zookeeper-latest-3.9.2_hadoop-latest-3.4.0_openshift-false --skip-release

--- PASS: kuttl (548.16s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/cluster-operation_druid-latest-28.0.1_zookeeper-latest-3.9.2_hadoop-latest-3.4.0_openshift-false (548.13s)
PASS

Rerun: ./scripts/run_tests.sh --test=resources_druid-latest-28.0.1_zookeeper-latest-3.9.2_openshift-false --skip-release

--- PASS: kuttl (285.90s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/resources_druid-latest-28.0.1_zookeeper-latest-3.9.2_openshift-false (285.86s)
PASS
Techassi commented 1 month ago

🟢 OPA

--- PASS: kuttl (127.09s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/resources_opa-latest-0.66.0_openshift-false (20.57s)
        --- PASS: kuttl/harness/aas-user-info_opa-latest-0.66.0_openshift-false (64.48s)
        --- PASS: kuttl/harness/keycloak-user-info_opa-latest-0.66.0_keycloak-23.0.1_openshift-false (94.67s)
        --- PASS: kuttl/harness/cluster-operation_opa-latest-0.66.0_openshift-false (22.70s)
        --- PASS: kuttl/harness/smoke_opa-0.66.0_openshift-false (14.18s)
        --- PASS: kuttl/harness/logging_opa-0.66.0_openshift-false (32.40s)
PASS
Techassi commented 1 month ago

🟢 Listener

--- PASS: kuttl (73.10s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/kerberos_krb5-1.21.1_openshift-false (24.65s)
        --- PASS: kuttl/harness/tls_openshift-false (60.86s)
        --- PASS: kuttl/harness/listener_openshift-false (48.43s)
PASS
Techassi commented 1 month ago

🟢 Spark K8s

--- PASS: kuttl (569.21s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/spark-ny-public-s3_openshift-false_spark-3.5.1_s3-use-tls-true (120.24s)
        --- PASS: kuttl/harness/smoke_openshift-false_spark-3.5.1_s3-use-tls-true (157.80s)
        --- PASS: kuttl/harness/spark-pi-public-s3_openshift-false_spark-3.5.1 (77.01s)
        --- PASS: kuttl/harness/spark-examples_openshift-false_spark-3.5.1 (25.19s)
        --- PASS: kuttl/harness/spark-history-server_openshift-false_spark-3.5.1_s3-use-tls-true (113.31s)
        --- PASS: kuttl/harness/pod_overrides_openshift-false_spark-3.5.1 (60.01s)
        --- PASS: kuttl/harness/delta-lake_openshift-false_spark-delta-lake-3.5.1_delta-3.1.0 (123.06s)
        --- PASS: kuttl/harness/resources_openshift-false_spark-3.5.1 (29.41s)
        --- PASS: kuttl/harness/iceberg_openshift-false_spark-3.5.1 (35.22s)
        --- PASS: kuttl/harness/spark-pi-private-s3_openshift-false_spark-3.5.1 (53.74s)
        --- PASS: kuttl/harness/pyspark-ny-public-s3-image_openshift-false_spark-3.5.1_ny-tlc-report-0.2.0 (65.81s)
        --- PASS: kuttl/harness/pyspark-ny-public-s3_openshift-false_spark-3.5.1 (63.28s)
        --- PASS: kuttl/harness/logging_openshift-false_spark-3.5.1_ny-tlc-report-0.2.0 (208.66s)
PASS
Techassi commented 1 month ago

🟢 Superset

--- PASS: kuttl (438.99s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/ldap_superset-4.0.2_ldap-authentication-no-tls_openshift-false (132.63s)
        --- PASS: kuttl/harness/smoke_superset-4.0.2_openshift-false (134.72s)
        --- PASS: kuttl/harness/cluster-operation_superset-latest-4.0.2_openshift-false (85.20s)
        --- PASS: kuttl/harness/ldap_superset-4.0.2_ldap-authentication-server-verification-tls_openshift-false (89.54s)
        --- PASS: kuttl/harness/ldap_superset-4.0.2_ldap-authentication-insecure-tls_openshift-false (81.44s)
        --- PASS: kuttl/harness/oidc_superset-4.0.2_openshift-false (135.22s)
        --- PASS: kuttl/harness/resources_superset-latest-4.0.2_openshift-false (83.26s)
        --- PASS: kuttl/harness/druid-connection_superset-4.0.2_openshift-false (43.32s)
        --- PASS: kuttl/harness/logging_superset-4.0.2_openshift-false (81.59s)
PASS
Maleware commented 1 month ago

🟢 Nifi ARM

--- FAIL: kuttl (7211.48s)
    --- FAIL: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/ldap_zookeeper-latest-3.9.2_nifi-1.21.0_ldap-use-tls-false_openshift-false (291.81s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.8.4_nifi-1.21.0_openshift-false_listener-class-external-unstable (157.96s)
        --- PASS: kuttl/harness/resources_zookeeper-latest-3.9.2_nifi-2.0.0-M4_openshift-false (282.47s)
        --- PASS: kuttl/harness/resources_zookeeper-latest-3.9.2_nifi-1.27.0_openshift-false (375.05s)
        --- FAIL: kuttl/harness/resources_zookeeper-latest-3.9.2_nifi-1.25.0_openshift-false (528.12s)
        --- PASS: kuttl/harness/resources_zookeeper-latest-3.9.2_nifi-1.21.0_openshift-false (371.86s)
        --- PASS: kuttl/harness/orphaned_resources_zookeeper-latest-3.9.2_nifi-2.0.0-M4_openshift-false (308.06s)
        --- PASS: kuttl/harness/orphaned_resources_zookeeper-latest-3.9.2_nifi-1.27.0_openshift-false (155.71s)
        --- PASS: kuttl/harness/orphaned_resources_zookeeper-latest-3.9.2_nifi-1.25.0_openshift-false (292.15s)
        --- PASS: kuttl/harness/orphaned_resources_zookeeper-latest-3.9.2_nifi-1.21.0_openshift-false (164.20s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.8.4_nifi-2.0.0-M4_openshift-false_listener-class-external-unstable (279.87s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.8.4_nifi-2.0.0-M4_openshift-false_listener-class-cluster-internal (153.73s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.8.4_nifi-1.27.0_openshift-false_listener-class-external-unstable (255.50s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.8.4_nifi-1.27.0_openshift-false_listener-class-cluster-internal (176.40s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.8.4_nifi-1.25.0_openshift-false_listener-class-external-unstable (169.00s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.8.4_nifi-1.25.0_openshift-false_listener-class-cluster-internal (165.68s)
        --- PASS: kuttl/harness/logging_zookeeper-latest-3.9.2_nifi-1.21.0_openshift-false (247.40s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.8.4_nifi-1.21.0_openshift-false_listener-class-cluster-internal (162.55s)
        --- PASS: kuttl/harness/cluster_operation_zookeeper-latest-3.9.2_nifi-latest-1.27.0_openshift-false (417.40s)
        --- PASS: kuttl/harness/upgrade_zookeeper-latest-3.9.2_nifi_old-1.25.0_nifi_new-1.27.0_openshift-false (379.51s)
        --- PASS: kuttl/harness/logging_zookeeper-latest-3.9.2_nifi-2.0.0-M4_openshift-false (80.63s)
        --- PASS: kuttl/harness/logging_zookeeper-latest-3.9.2_nifi-1.27.0_openshift-false (192.27s)
        --- PASS: kuttl/harness/logging_zookeeper-latest-3.9.2_nifi-1.25.0_openshift-false (299.91s)
        --- PASS: kuttl/harness/ldap_zookeeper-latest-3.9.2_nifi-1.27.0_ldap-use-tls-false_openshift-false (196.03s)
        --- PASS: kuttl/harness/ldap_zookeeper-latest-3.9.2_nifi-2.0.0-M4_ldap-use-tls-true_openshift-false (193.64s)
        --- PASS: kuttl/harness/ldap_zookeeper-latest-3.9.2_nifi-2.0.0-M4_ldap-use-tls-false_openshift-false (174.59s)
        --- PASS: kuttl/harness/ldap_zookeeper-latest-3.9.2_nifi-1.27.0_ldap-use-tls-true_openshift-false (196.89s)
        --- PASS: kuttl/harness/ldap_zookeeper-latest-3.9.2_nifi-1.25.0_ldap-use-tls-false_openshift-false (170.14s)
        --- PASS: kuttl/harness/ldap_zookeeper-latest-3.9.2_nifi-1.25.0_ldap-use-tls-true_openshift-false (183.32s)
        --- PASS: kuttl/harness/ldap_zookeeper-latest-3.9.2_nifi-1.21.0_ldap-use-tls-true_openshift-false (189.63s)
FAIL
ERROR:root:kuttl failed

Rerun: ./scripts/run_tests.sh --test=resources_zookeeper-latest-3.9.2_nifi-1.25.0_openshift-false --skip-release

--- PASS: kuttl (319.31s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/resources_zookeeper-latest-3.9.2_nifi-1.25.0_openshift-false (234.78s)
        --- PASS: kuttl/harness/orphaned_resources_zookeeper-latest-3.9.2_nifi-1.25.0_openshift-false (319.27s)
PASS
Techassi commented 1 month ago

🟢 Trino

--- PASS: kuttl (1424.93s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/logging_trino-451_openshift-false (185.38s)
        --- PASS: kuttl/harness/authentication_trino-latest-451_ldap-use-tls-false_openshift-false (265.63s)
        --- PASS: kuttl/harness/smoke_trino-451_hive-3.1.3_opa-0.66.0_hdfs-3.4.0_zookeeper-3.9.2_s3-use-tls-true_openshift-false (523.40s)
        --- PASS: kuttl/harness/authentication_trino-latest-451_ldap-use-tls-true_openshift-false (241.87s)
        --- PASS: kuttl/harness/tls_trino-latest-451_use-authentication-true_use-tls-false_use-internal-tls-true_openshift-false (54.59s)
        --- PASS: kuttl/harness/orphaned-resources_trino-latest-451_openshift-false (226.99s)
        --- PASS: kuttl/harness/resources_trino-latest-451_openshift-false (51.74s)
        --- PASS: kuttl/harness/cluster-operation_trino-latest-451_openshift-false (89.53s)
        --- PASS: kuttl/harness/tls_trino-latest-451_use-authentication-true_use-tls-true_use-internal-tls-true_openshift-false (93.54s)
        --- PASS: kuttl/harness/tls_trino-latest-451_use-authentication-true_use-tls-true_use-internal-tls-false_openshift-false (145.70s)
        --- PASS: kuttl/harness/tls_trino-latest-451_use-authentication-false_use-tls-true_use-internal-tls-false_openshift-false (135.89s)
        --- PASS: kuttl/harness/opa-authorization_trino-latest-451_hive-3.1.3_opa-0.66.0_keycloak-25.0.0_openshift-false (426.38s)
        --- PASS: kuttl/harness/tls_trino-latest-451_use-authentication-false_use-tls-true_use-internal-tls-true_openshift-false (135.49s)
        --- PASS: kuttl/harness/tls_trino-latest-451_use-authentication-false_use-tls-false_use-internal-tls-true_openshift-false (139.58s)
        --- PASS: kuttl/harness/tls_trino-latest-451_use-authentication-false_use-tls-false_use-internal-tls-false_openshift-false (35.62s)
        --- PASS: kuttl/harness/tls_trino-latest-451_use-authentication-true_use-tls-false_use-internal-tls-false_openshift-false (59.75s)
PASS
Maleware commented 1 month ago

🟢 Hive ARM

--- PASS: kuttl (764.09s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/cluster-operation_hive-latest-3.1.3_openshift-false (50.41s)
        --- PASS: kuttl/harness/kerberos-s3_postgres-12.5.6_hive-3.1.3_krb5-1.21.1_openshift-false_s3-use-tls-true_kerberos-realm-PROD.MYCORP_kerberos-backend-mit (109.71s)
        --- PASS: kuttl/harness/orphaned-resources_hive-latest-3.1.3_openshift-false (28.75s)
        --- PASS: kuttl/harness/resources_hive-3.1.3_openshift-false (26.27s)
        --- PASS: kuttl/harness/kerberos-hdfs_postgres-12.5.6_hive-3.1.3_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_krb5-1.21.1_openshift-false_kerberos-realm-PROD.MYCORP_kerberos-backend-mit (181.66s)
        --- PASS: kuttl/harness/logging_postgres-12.5.6_hive-3.1.3_openshift-false (76.50s)
        --- PASS: kuttl/harness/kerberos-s3_postgres-12.5.6_hive-3.1.3_krb5-1.21.1_openshift-false_s3-use-tls-false_kerberos-realm-PROD.MYCORP_kerberos-backend-mit (103.86s)
        --- PASS: kuttl/harness/smoke_postgres-12.5.6_hive-3.1.3_openshift-false_s3-use-tls-true (89.45s)
        --- PASS: kuttl/harness/smoke_postgres-12.5.6_hive-3.1.3_openshift-false_s3-use-tls-false (97.45s)
PASS
Techassi commented 1 month ago

🟢 ZooKeeper

--- PASS: kuttl (143.47s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/cluster-operation_zookeeper-latest-3.9.2_openshift-false (53.01s)
        --- PASS: kuttl/harness/delete-rolegroup_zookeeper-3.9.2_openshift-false (80.16s)
        --- PASS: kuttl/harness/logging_zookeeper-3.9.2_openshift-false (68.57s)
        --- PASS: kuttl/harness/znode_zookeeper-latest-3.9.2_openshift-false (16.26s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.9.2_use-server-tls-true_use-client-auth-tls-true_openshift-false (63.30s)
PASS
Maleware commented 1 month ago

🟢 Listener ARM

--- PASS: kuttl (28.80s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/smoke-nodeport_openshift-false (28.76s)
PASS
NickLarsenNZ commented 1 month ago

🟢 HBase

Getting started is a little flakey. It has failed (maybe due to image pull issue locally), but worked second time without a change.

Some integration tests fail

Name:             access-hdfs-qq6hp
Namespace:        kuttl-test-strong-frog
...
Events:
  Type    Reason   Age                  From     Message
  ----    ------   ----                 ----     -------
  Normal  BackOff  17s (x350 over 80m)  kubelet  Back-off pulling image "docker.stackable.tech/stackable/hadoop:3.3.6-stackable0.0.0-dev"
❯ docker pull docker.stackable.tech/stackable/hadoop:3.3.6-stackable0.0.0-dev
3.3.6-stackable0.0.0-dev: Pulling from stackable/hadoop
fde3ad1312f5: Already exists
9bc0604c6b64: Downloading
25c6ec40b4ba: Downloading
f69009f8e94f: Downloading
7ae27fbaef6e: Waiting
2e06cac4297a: Waiting
91fbddf10019: Downloading
f5cc963bd0ad: Waiting
ad75c7d95418: Waiting
2667a9a4c2d8: Waiting
a005994ec777: Waiting
faadcef6aeee: Waiting
0cb245f257c9: Waiting
0342fa48e4a1: Waiting
4f4fb700ef54: Waiting
a27f4630648a: Waiting
359b15aa3ad7: Waiting
21997fb8752d: Waiting
96d6909cc376: Waiting
4a5eb0fa0863: Waiting
58e4ed1a1498: Waiting
14013ada8935: Waiting
unknown blob

I noticed a lot of 0.0.0-dev references in the tests (excluding testing-tools):

Image

After fixing image refs, the tests all work:

Maleware commented 1 month ago

🟢 Spark-K8s ARM

--- FAIL: kuttl (5410.19s)
    --- FAIL: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/logging_openshift-false_spark-3.4.2_ny-tlc-report-0.2.0 (308.97s)
        --- PASS: kuttl/harness/iceberg_openshift-false_spark-3.4.3 (85.72s)
        --- PASS: kuttl/harness/spark-history-server_openshift-false_spark-3.5.1_s3-use-tls-true (155.63s)
        --- PASS: kuttl/harness/spark-history-server_openshift-false_spark-3.5.1_s3-use-tls-false (159.27s)
        --- PASS: kuttl/harness/spark-history-server_openshift-false_spark-3.4.3_s3-use-tls-true (169.77s)
        --- PASS: kuttl/harness/spark-history-server_openshift-false_spark-3.4.3_s3-use-tls-false (146.90s)
        --- PASS: kuttl/harness/spark-history-server_openshift-false_spark-3.4.2_s3-use-tls-true (168.95s)
        --- PASS: kuttl/harness/spark-history-server_openshift-false_spark-3.4.2_s3-use-tls-false (151.96s)
        --- PASS: kuttl/harness/pod_overrides_openshift-false_spark-3.5.1 (108.72s)
        --- PASS: kuttl/harness/pod_overrides_openshift-false_spark-3.4.3 (117.68s)
        --- PASS: kuttl/harness/pod_overrides_openshift-false_spark-3.4.2 (114.69s)
        --- PASS: kuttl/harness/spark-pi-public-s3_openshift-false_spark-3.5.1 (85.32s)
        --- PASS: kuttl/harness/spark-pi-public-s3_openshift-false_spark-3.4.3 (85.39s)
        --- PASS: kuttl/harness/spark-pi-public-s3_openshift-false_spark-3.4.2 (86.28s)
        --- PASS: kuttl/harness/smoke_openshift-false_spark-3.5.1_s3-use-tls-true (117.14s)
        --- PASS: kuttl/harness/smoke_openshift-false_spark-3.5.1_s3-use-tls-false (108.44s)
        --- PASS: kuttl/harness/smoke_openshift-false_spark-3.4.3_s3-use-tls-true (129.61s)
        --- PASS: kuttl/harness/smoke_openshift-false_spark-3.4.3_s3-use-tls-false (105.42s)
        --- PASS: kuttl/harness/smoke_openshift-false_spark-3.4.2_s3-use-tls-true (132.63s)
        --- PASS: kuttl/harness/smoke_openshift-false_spark-3.4.2_s3-use-tls-false (128.63s)
        --- PASS: kuttl/harness/resources_openshift-false_spark-3.5.1 (78.15s)
        --- PASS: kuttl/harness/resources_openshift-false_spark-3.4.3 (67.00s)
        --- PASS: kuttl/harness/resources_openshift-false_spark-3.4.2 (79.05s)
        --- PASS: kuttl/harness/iceberg_openshift-false_spark-3.5.1 (41.61s)
        --- PASS: kuttl/harness/pyspark-ny-public-s3_openshift-false_spark-3.5.1 (97.68s)
        --- PASS: kuttl/harness/iceberg_openshift-false_spark-3.4.2 (47.61s)
        --- PASS: kuttl/harness/spark-examples_openshift-false_spark-3.5.1 (33.43s)
        --- PASS: kuttl/harness/spark-examples_openshift-false_spark-3.4.3 (35.58s)
        --- PASS: kuttl/harness/spark-examples_openshift-false_spark-3.4.2 (34.38s)
        --- PASS: kuttl/harness/spark-ny-public-s3_openshift-false_spark-3.5.1_s3-use-tls-true (103.10s)
        --- PASS: kuttl/harness/spark-ny-public-s3_openshift-false_spark-3.5.1_s3-use-tls-false (98.23s)
        --- FAIL: kuttl/harness/spark-ny-public-s3_openshift-false_spark-3.4.3_s3-use-tls-true (57.07s)
        --- FAIL: kuttl/harness/spark-ny-public-s3_openshift-false_spark-3.4.3_s3-use-tls-false (57.72s)
        --- PASS: kuttl/harness/spark-ny-public-s3_openshift-false_spark-3.4.2_s3-use-tls-true (107.10s)
        --- PASS: kuttl/harness/spark-ny-public-s3_openshift-false_spark-3.4.2_s3-use-tls-false (104.40s)
        --- PASS: kuttl/harness/spark-pi-private-s3_openshift-false_spark-3.5.1 (88.49s)
        --- PASS: kuttl/harness/pyspark-ny-public-s3_openshift-false_spark-3.4.3 (97.50s)
        --- PASS: kuttl/harness/pyspark-ny-public-s3_openshift-false_spark-3.4.2 (101.71s)
        --- PASS: kuttl/harness/pyspark-ny-public-s3-image_openshift-false_spark-3.5.1_ny-tlc-report-0.2.0 (379.16s)
        --- PASS: kuttl/harness/pyspark-ny-public-s3-image_openshift-false_spark-3.4.3_ny-tlc-report-0.2.0 (105.28s)
        --- PASS: kuttl/harness/pyspark-ny-public-s3-image_openshift-false_spark-3.4.2_ny-tlc-report-0.2.0 (101.58s)
        --- PASS: kuttl/harness/delta-lake_openshift-false_spark-delta-lake-3.5.1_delta-3.1.0 (162.17s)
        --- PASS: kuttl/harness/spark-pi-private-s3_openshift-false_spark-3.4.3 (89.56s)
        --- PASS: kuttl/harness/spark-pi-private-s3_openshift-false_spark-3.4.2 (90.50s)
        --- PASS: kuttl/harness/logging_openshift-false_spark-3.5.1_ny-tlc-report-0.2.0 (234.04s)
        --- PASS: kuttl/harness/logging_openshift-false_spark-3.4.3_ny-tlc-report-0.2.0 (250.92s)
FAIL
ERROR:root:kuttl failed

Rerun: ./scripts/run_tests.sh --test=spark-ny-public-s3_openshift-false_spark-3.4.3_s3-use-tls-true --skip-release with fix: https://github.com/stackabletech/spark-k8s-operator/pull/438

--- PASS: kuttl (108.25s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/spark-ny-public-s3_openshift-false_spark-3.4.3_s3-use-tls-true (108.21s)
PASS

Rerun: ./scripts/run_tests.sh --test=spark-ny-public-s3_openshift-false_spark-3.4.3_s3-use-tls-false --skip-release with fix: https://github.com/stackabletech/spark-k8s-operator/pull/438

--- PASS: kuttl (109.67s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/spark-ny-public-s3_openshift-false_spark-3.4.3_s3-use-tls-false (109.64s)
PASS
Maleware commented 1 month ago

🟢 Trino ARM

--- PASS: kuttl (5289.16s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/cluster-operation_trino-latest-451_openshift-false (130.17s)
        --- PASS: kuttl/harness/smoke_trino-451_hive-3.1.3_opa-0.66.0_hdfs-3.4.0_zookeeper-3.9.2_s3-use-tls-false_openshift-false (569.32s)
        --- PASS: kuttl/harness/smoke_trino-451_hive-3.1.3_opa-0.66.0_hdfs-3.4.0_zookeeper-3.9.2_s3-use-tls-true_openshift-false (540.88s)
        --- PASS: kuttl/harness/tls_trino-latest-451_use-authentication-false_use-tls-true_use-internal-tls-false_openshift-false (74.45s)
        --- PASS: kuttl/harness/smoke_trino-442_hive-3.1.3_opa-0.66.0_hdfs-3.4.0_zookeeper-3.9.2_s3-use-tls-true_openshift-false (613.89s)
        --- PASS: kuttl/harness/smoke_trino-442_hive-3.1.3_opa-0.66.0_hdfs-3.4.0_zookeeper-3.9.2_s3-use-tls-false_openshift-false (547.11s)
        --- PASS: kuttl/harness/smoke_trino-414_hive-3.1.3_opa-0.66.0_hdfs-3.4.0_zookeeper-3.9.2_s3-use-tls-true_openshift-false (579.65s)
        --- PASS: kuttl/harness/smoke_trino-414_hive-3.1.3_opa-0.66.0_hdfs-3.4.0_zookeeper-3.9.2_s3-use-tls-false_openshift-false (526.54s)
        --- PASS: kuttl/harness/tls_trino-latest-451_use-authentication-true_use-tls-true_use-internal-tls-true_openshift-false (90.61s)
        --- PASS: kuttl/harness/tls_trino-latest-451_use-authentication-true_use-tls-true_use-internal-tls-false_openshift-false (74.77s)
        --- PASS: kuttl/harness/tls_trino-latest-451_use-authentication-true_use-tls-false_use-internal-tls-true_openshift-false (69.80s)
        --- PASS: kuttl/harness/tls_trino-latest-451_use-authentication-true_use-tls-false_use-internal-tls-false_openshift-false (65.41s)
        --- PASS: kuttl/harness/tls_trino-latest-451_use-authentication-false_use-tls-true_use-internal-tls-true_openshift-false (81.33s)
        --- PASS: kuttl/harness/authentication_trino-latest-451_ldap-use-tls-false_openshift-false (303.97s)
        --- PASS: kuttl/harness/tls_trino-latest-451_use-authentication-false_use-tls-false_use-internal-tls-true_openshift-false (75.23s)
        --- PASS: kuttl/harness/tls_trino-latest-451_use-authentication-false_use-tls-false_use-internal-tls-false_openshift-false (64.58s)
        --- PASS: kuttl/harness/orphaned-resources_trino-latest-451_openshift-false (51.94s)
        --- PASS: kuttl/harness/authentication_trino-latest-451_ldap-use-tls-true_openshift-false (266.86s)
        --- PASS: kuttl/harness/logging_trino-414_openshift-false (82.03s)
        --- PASS: kuttl/harness/logging_trino-451_openshift-false (76.51s)
        --- PASS: kuttl/harness/logging_trino-442_openshift-false (88.75s)
        --- PASS: kuttl/harness/resources_trino-latest-451_openshift-false (50.32s)
        --- PASS: kuttl/harness/opa-authorization_trino-latest-451_hive-3.1.3_opa-0.66.0_keycloak-25.0.0_openshift-false (265.04s)
PASS

with fix: https://github.com/stackabletech/trino-operator/pull/622

Techassi commented 1 month ago

🟢 Hello World

--- PASS: kuttl (72.76s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/smoke_openshift-false (35.40s)
        --- PASS: kuttl/harness/check-name_openshift-false (72.74s)
PASS
Maleware commented 1 month ago

🟢 Superset ARM

2.1.3 omitted since known not to compile on arm64

--- PASS: kuttl (2403.83s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/resources_superset-latest-4.0.2_openshift-false (92.38s)
        --- PASS: kuttl/harness/oidc_superset-3.1.3_openshift-false (128.11s)
        --- PASS: kuttl/harness/druid-connection_superset-4.0.2_openshift-false (68.20s)
        --- PASS: kuttl/harness/druid-connection_superset-3.1.3_openshift-false (79.32s)
        --- PASS: kuttl/harness/druid-connection_superset-3.1.0_openshift-false (66.52s)
        --- PASS: kuttl/harness/smoke_superset-4.0.2_openshift-false (87.92s)
        --- PASS: kuttl/harness/smoke_superset-3.1.3_openshift-false (90.03s)
        --- PASS: kuttl/harness/smoke_superset-3.1.0_openshift-false (86.95s)
        --- PASS: kuttl/harness/logging_superset-4.0.2_openshift-false (105.27s)
        --- PASS: kuttl/harness/logging_superset-3.1.3_openshift-false (143.02s)
        --- PASS: kuttl/harness/logging_superset-3.1.0_openshift-false (85.48s)
        --- PASS: kuttl/harness/oidc_superset-4.0.2_openshift-false (121.96s)
        --- PASS: kuttl/harness/ldap_superset-3.1.3_ldap-authentication-no-tls_openshift-false (104.79s)
        --- PASS: kuttl/harness/ldap_superset-4.0.2_ldap-authentication-insecure-tls_openshift-false (122.01s)
        --- PASS: kuttl/harness/ldap_superset-3.1.3_ldap-authentication-server-verification-tls_openshift-false (81.35s)
        --- PASS: kuttl/harness/ldap_superset-3.1.0_ldap-authentication-no-tls_openshift-false (101.74s)
        --- PASS: kuttl/harness/ldap_superset-3.1.3_ldap-authentication-insecure-tls_openshift-false (120.42s)
        --- PASS: kuttl/harness/ldap_superset-3.1.0_ldap-authentication-server-verification-tls_openshift-false (121.77s)
        --- PASS: kuttl/harness/ldap_superset-3.1.0_ldap-authentication-insecure-tls_openshift-false (121.31s)
        --- PASS: kuttl/harness/cluster-operation_superset-latest-4.0.2_openshift-false (78.98s)
        --- PASS: kuttl/harness/oidc_superset-3.1.0_openshift-false (135.57s)
        --- PASS: kuttl/harness/ldap_superset-4.0.2_ldap-authentication-server-verification-tls_openshift-false (123.17s)
        --- PASS: kuttl/harness/ldap_superset-4.0.2_ldap-authentication-no-tls_openshift-false (137.55s)
PASS
Maleware commented 1 month ago

🟠 Hbase ARM

--- FAIL: kuttl (9219.58s)
    --- FAIL: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/cluster-operation_hbase-latest-2.4.18_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_openshift-false (132.93s)
        --- PASS: kuttl/harness/kerberos_hbase-2.6.0_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_krb5-1.21.1_listener-class-external-unstable_kerberos-realm-PROD.MYCORP_kerberos-backend-mit_openshift-false (386.57s)
        --- PASS: kuttl/harness/logging_hbase-2.6.0_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_openshift-false (127.37s)
        --- PASS: kuttl/harness/logging_hbase-2.4.18_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_openshift-false (128.24s)
        --- PASS: kuttl/harness/omid_hbase-2.6.0_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_openshift-false_omid-1.1.0 (344.38s)
        --- PASS: kuttl/harness/omid_hbase-2.4.18_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_openshift-false_omid-1.1.0 (300.02s)
        --- FAIL: kuttl/harness/smoke_hbase-2.6.0_hdfs-3.3.6_zookeeper-3.8.4_listener-class-external-unstable_openshift-false (511.37s)
        --- FAIL: kuttl/harness/smoke_hbase-2.6.0_hdfs-3.3.6_zookeeper-3.8.4_listener-class-cluster-internal_openshift-false (388.59s)
        --- FAIL: kuttl/harness/smoke_hbase-2.6.0_hdfs-3.3.4_zookeeper-3.8.4_listener-class-external-unstable_openshift-false (600.03s)
        --- FAIL: kuttl/harness/smoke_hbase-2.6.0_hdfs-3.3.4_zookeeper-3.8.4_listener-class-cluster-internal_openshift-false (504.93s)
        --- PASS: kuttl/harness/smoke_hbase-2.4.18_hdfs-3.3.6_zookeeper-3.8.4_listener-class-external-unstable_openshift-false (395.05s)
        --- PASS: kuttl/harness/smoke_hbase-2.4.18_hdfs-3.3.6_zookeeper-3.8.4_listener-class-cluster-internal_openshift-false (167.25s)
        --- PASS: kuttl/harness/smoke_hbase-2.4.18_hdfs-3.3.4_zookeeper-3.8.4_listener-class-external-unstable_openshift-false (156.48s)
        --- PASS: kuttl/harness/smoke_hbase-2.4.18_hdfs-3.3.4_zookeeper-3.8.4_listener-class-cluster-internal_openshift-false (276.29s)
        --- PASS: kuttl/harness/orphaned_resources_hbase-latest-2.4.18_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_openshift-false (101.39s)
        --- PASS: kuttl/harness/kerberos_hbase-2.4.18_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_krb5-1.21.1_listener-class-cluster-internal_kerberos-realm-CLUSTER.LOCAL_kerberos-backend-mit_openshift-false (498.60s)
        --- FAIL: kuttl/harness/kerberos_hbase-2.6.0_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_krb5-1.21.1_listener-class-external-unstable_kerberos-realm-CLUSTER.LOCAL_kerberos-backend-mit_openshift-false (557.68s)
        --- PASS: kuttl/harness/kerberos_hbase-2.6.0_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_krb5-1.21.1_listener-class-cluster-internal_kerberos-realm-PROD.MYCORP_kerberos-backend-mit_openshift-false (342.34s)
        --- FAIL: kuttl/harness/kerberos_hbase-2.6.0_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_krb5-1.21.1_listener-class-cluster-internal_kerberos-realm-CLUSTER.LOCAL_kerberos-backend-mit_openshift-false (543.19s)
        --- PASS: kuttl/harness/kerberos_hbase-2.4.18_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_krb5-1.21.1_listener-class-external-unstable_kerberos-realm-PROD.MYCORP_kerberos-backend-mit_openshift-false (356.81s)
        --- FAIL: kuttl/harness/kerberos_hbase-2.4.18_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_krb5-1.21.1_listener-class-external-unstable_kerberos-realm-CLUSTER.LOCAL_kerberos-backend-mit_openshift-false (569.45s)
        --- PASS: kuttl/harness/kerberos_hbase-2.4.18_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_krb5-1.21.1_listener-class-cluster-internal_kerberos-realm-PROD.MYCORP_kerberos-backend-mit_openshift-false (330.65s)
        --- PASS: kuttl/harness/resources_hbase-latest-2.4.18_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_openshift-false (95.67s)
        --- FAIL: kuttl/harness/snapshot-export_hbase-2.6.0_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_openshift-false (443.52s)
        --- PASS: kuttl/harness/snapshot-export_hbase-2.4.18_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_openshift-false (168.97s)
        --- PASS: kuttl/harness/profiling_hbase-2.4.18_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_openshift-false (191.77s)
        --- PASS: kuttl/harness/profiling_hbase-2.6.0_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_openshift-false (299.99s)
        --- PASS: kuttl/harness/opa_hbase-opa-2.6.0_hdfs-latest-3.3.6_zookeeper-latest-3.9.2_krb5-1.21.1_openshift-false (300.02s)
FAIL

I've reran all of them, but they didn't get green. This was always due to pod's or pvc's not getting clean up before the timeout was over. I would say it's fine from this point.