FIWARE / data-space-connector

FIWARE Data Space Connector following DSBA TC recommendations
MIT License
18 stars 2 forks source link

Local deployment not working #24

Open hokonohara opened 1 month ago

hokonohara commented 1 month ago

This is the first time I try, and I don't have understanding about the background architecture et cetera. I just want first try the running the MVD to get grip. Environment: Ubuntu 24.04 fresh install on Hyper-V. After sudo update, installed git, maven and docker 27.3.1 Just run the "mvn clean deploy -Plocal" I always get error: Any hint what should I check?

[INFO] Downloading postgresql from repo oci://registry-1.docker.io/bitnamicharts
[ERROR] Pulled: registry-1.docker.io/bitnamicharts/postgresql:13.1.5
[ERROR] Digest: sha256:b4c742976290356be9c3483f1abddbc4c7ed8a16d80692901a07385133ff0899
[INFO] Downloading vcverifier from repo https://fiware.github.io/helm-charts
[INFO] Downloading credentials-config-service from repo https://fiware.github.io/helm-charts
[INFO] Downloading trusted-issuers-list from repo https://fiware.github.io/helm-charts
[INFO] Downloading mysql from repo https://charts.bitnami.com/bitnami
[INFO] Downloading odrl-pap from repo https://fiware.github.io/helm-charts
[INFO] Downloading apisix from repo oci://registry-1.docker.io/bitnamicharts
[ERROR] Pulled: registry-1.docker.io/bitnamicharts/apisix:3.5.1
[ERROR] Digest: sha256:1667bd749de452c81bbe6fe29de4ed91a08d6ab7350a575783d8bbf950fecbfd
[INFO] Downloading scorpio-broker-aaio from repo https://fiware.github.io/helm-charts
[INFO] Downloading postgresql from repo oci://registry-1.docker.io/bitnamicharts
[ERROR] Pulled: registry-1.docker.io/bitnamicharts/postgresql:13.2.0
[ERROR] Digest: sha256:16cad00f1daf059ff03d9188fc2885fbf23ebb92d3921aad47ea74cf2fc5538f
[INFO] Downloading keycloak from repo https://charts.bitnami.com/bitnami
[INFO] Downloading tm-forum-api from repo https://fiware.github.io/helm-charts
[INFO] Downloading contract-management from repo https://fiware.github.io/helm-charts
[INFO] Deleting outdated charts
[ERROR] >>> docker exec k3s-maven-plugin kubectl rollout status deployment provider-apisix-data-plane --namespace=provider --timeout=300s (timeout: PT5M10S)
[ERROR] <<< error: deployment "provider-apisix-data-plane" exceeded its progress deadline
[INFO] deployment provider/dsconfig ... ready
[INFO] pod provider/provider-tm-forum-api-product-ordering-management-6dc787779lhcn ... ready
[ERROR] >>> docker exec k3s-maven-plugin kubectl rollout status deployment provider-apisix-control-plane --namespace=provider --timeout=300s (timeout: PT5M10S)
[ERROR] <<< error: deployment "provider-apisix-control-plane" exceeded its progress deadline
[ERROR] >>> docker exec k3s-maven-plugin kubectl rollout status deployment odrl-pap --namespace=provider --timeout=300s (timeout: PT5M10S)
[ERROR] <<< error: deployment "odrl-pap" exceeded its progress deadline
[INFO] statefulset consumer/postgresql ... ready
[ERROR] >>> docker exec k3s-maven-plugin kubectl rollout status deployment credentials-config-service --namespace=provider --timeout=300s (timeout: PT5M10S)
[ERROR] <<< error: deployment "credentials-config-service" exceeded its progress deadline
[ERROR] >>> docker exec k3s-maven-plugin kubectl rollout status deployment data-service-scorpio --namespace=provider --timeout=300s (timeout: PT5M10S)
[ERROR] <<< error: deployment "data-service-scorpio" exceeded its progress deadline
[INFO] deployment infra/traefik ... ready
[INFO] statefulset trust-anchor/trust-anchor-mysql ... ready
[INFO] deployment provider/provider-tm-forum-api-party-catalog ... ready
[ERROR] >>> docker exec k3s-maven-plugin kubectl rollout status deployment tir --namespace=trust-anchor --timeout=300s (timeout: PT5M10S)
[ERROR] <<< error: deployment "tir" exceeded its progress deadline
[INFO] statefulset provider/data-service-postgis ... ready
[INFO] deployment provider/provider-tm-forum-api-envoy ... ready
[INFO] deployment kube-system/coredns ... ready
[INFO] pod provider/provider-tm-forum-api-resource-function-activation-59f9f44g9nnl ... ready
[INFO] deployment provider/provider-tm-forum-api-product-ordering-management ... ready
[ERROR] >>> docker exec k3s-maven-plugin kubectl rollout status deployment provider-apisix-dashboard --namespace=provider --timeout=300s (timeout: PT5M10S)
[ERROR] <<< error: deployment "provider-apisix-dashboard" exceeded its progress deadline
[ERROR] >>> docker exec k3s-maven-plugin kubectl rollout status deployment verifier --namespace=provider --timeout=300s (timeout: PT5M10S)
[ERROR] <<< error: deployment "verifier" exceeded its progress deadline
[INFO] Still waiting for: [consumer/consumer-keycloak, provider/provider-etcd, provider/tmf-api-registration]
[ERROR] >>> docker exec k3s-maven-plugin kubectl rollout status statefulset provider-etcd --namespace=provider --timeout=300s (timeout: PT5M10S)
[ERROR] <<< Waiting for 3 pods to be ready...
[ERROR] <<< error: timed out waiting for the condition
[ERROR] >>> docker exec k3s-maven-plugin kubectl wait --for=condition=complete job tmf-api-registration --namespace=provider --timeout=300s (timeout: PT5M10S)
[ERROR] <<< error: timed out waiting for the condition on jobs/tmf-api-registration
[INFO] Still waiting for: [consumer/consumer-keycloak, provider/tmf-api-registration]
[ERROR] >>> docker exec k3s-maven-plugin kubectl rollout status statefulset consumer-keycloak --namespace=consumer --timeout=300s (timeout: PT5M10S)
[ERROR] <<< Waiting for 1 pods to be ready...
[ERROR] <<< error: timed out waiting for the condition
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for connector 0.0.1:
[INFO] 
[INFO] connector .......................................... FAILURE [07:09 min]
[INFO] it ................................................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  07:09 min
[INFO] Finished at: 2024-10-20T16:14:24+01:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal io.kokuwa.maven:k3s-maven-plugin:1.3.0:apply (create-namespaces) on project connector: Failed to wait for resources, see previous log -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
wistefan commented 2 weeks ago

Hi, sorry for not seeing this earlier. Can you check with

  export KUBECONFIG=$(pwd)/target/k3s.yaml
  kubectl describe pod consumer-keycloak -n consumer
  kubectl logs consumer-keycloak -n consumer

why Keycloak does not come up?

hokonohara commented 2 weeks ago

I don't have k3s.yaml in target folder. Something wrong with k3s?

ubuntu@fiware:~/fiware/data-space-connector$ ls target
charts  helm  k3s
ubuntu@fiware:~/fiware/data-space-connector$ sudo k3s kubectl get all
NAME                 TYPE        CLUSTER-IP   EXTERNAL-IP   PORT(S)   AGE
service/kubernetes   ClusterIP   10.43.0.1    <none>        443/TCP   16m
ubuntu@fiware:~/fiware/data-space-connector$ docker ps -a
CONTAINER ID   IMAGE                COMMAND                  CREATED          STATUS    PORTS     NAMES
bdb453a47c5f   rancher/k3s:latest   "/bin/k3s server --n…"   11 minutes ago   Created             k3s-maven-plugin
hokonohara commented 2 weeks ago

Uninstalled k3s, tried running mvn again. Still error, but I have k3s.yaml now.

ubuntu@fiware:~/fiware/data-space-connector$ ls target/
charts  helm  k3s  k3s.yaml  maven-status
ubuntu@fiware:~/fiware/data-space-connector$ export KUBECONFIG=$(pwd)/target/k3s.yaml
ubuntu@fiware:~/fiware/data-space-connector$ kubectl describe pod consumer-keycloak -n consumer
Name:             consumer-keycloak-0
Namespace:        consumer
Priority:         0
Service Account:  consumer-keycloak
Node:             k3s/172.17.0.2
Start Time:       Fri, 08 Nov 2024 19:14:04 +0000
Labels:           app.kubernetes.io/component=keycloak
                  app.kubernetes.io/instance=consumer
                  app.kubernetes.io/managed-by=Helm
                  app.kubernetes.io/name=keycloak
                  app.kubernetes.io/version=24.0.3
                  apps.kubernetes.io/pod-index=0
                  controller-revision-hash=consumer-keycloak-d89758d8d
                  helm.sh/chart=keycloak-21.1.1
                  statefulset.kubernetes.io/pod-name=consumer-keycloak-0
Annotations:      checksum/configmap-env-vars: 5b43785d21148e2b835d8f29ad861529695253ddcb676c7cc36e0ee3db9bb216
Status:           Pending
IP:               10.42.0.3
IPs:
  IP:           10.42.0.3
Controlled By:  StatefulSet/consumer-keycloak
Init Containers:
  read-only-workaround:
    Container ID:  containerd://4f3014d47dd368a553a5c3dc22bc4632d9a17a73169051fa3ce801832ad82615
    Image:         quay.io/wi_stefan/keycloak:25.0.0-PRE
    Image ID:      quay.io/wi_stefan/keycloak@sha256:ba2c3dd30274b8c1e1eff7eb7134c2869b33ee9092ca1301357e51628712fe05
    Port:          <none>
    Host Port:     <none>
    Command:
      /bin/bash
    Args:
      -ec
      #!/bin/bash
      cp -r /opt/keycloak/lib/quarkus/* /quarkus

    State:          Terminated
      Reason:       Completed
      Exit Code:    0
      Started:      Fri, 08 Nov 2024 19:15:14 +0000
      Finished:     Fri, 08 Nov 2024 19:15:14 +0000
    Ready:          True
    Restart Count:  0
    Environment:    <none>
    Mounts:
      /quarkus from empty-dir (rw,path="app-quarkus-dir")
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-nqxlx (ro)
  get-did:
    Container ID:  containerd://ec8f1617a4892f4865009c82e81b4cb8bcf97f40fd65b1ce6e8c468daeead2a9
    Image:         ubuntu
    Image ID:      docker.io/library/ubuntu@sha256:99c35190e22d294cdace2783ac55effc69d32896daaa265f0bbedbcde4fbe3e5
    Port:          <none>
    Host Port:     <none>
    Command:
      /bin/bash
    Args:
      -ec
      #!/bin/bash
      apt-get -y update; apt-get -y install wget; apt-get -y install sed;

      cd /did-material
      wget http://did-helper:3001/did-material/cert.pfx
      wget http://did-helper:3001/did-material/did.env
      mkdir -p /did-material/client
      cd /did-material/client
      wget http://did-helper.provider.svc.cluster.local:3002/did-material/did.env
      sed -i -e 's/DID/CLIENT_DID/g' /did-material/client/did.env
      echo "" >> /did-material/did.env
      echo $(cat /did-material/client/did.env) >> /did-material/did.env
      echo $(cat /did-material/did.env)

    State:          Terminated
      Reason:       Completed
      Exit Code:    0
      Started:      Fri, 08 Nov 2024 19:15:20 +0000
      Finished:     Fri, 08 Nov 2024 19:15:59 +0000
    Ready:          True
    Restart Count:  0
    Environment:    <none>
    Mounts:
      /did-material from did-material (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-nqxlx (ro)
  register-at-tir:
    Container ID:  containerd://07376f3fa7aa370da13974619db06eaadec844860bb9d6ea50af127f92a3b42a
    Image:         ubuntu
    Image ID:      docker.io/library/ubuntu@sha256:99c35190e22d294cdace2783ac55effc69d32896daaa265f0bbedbcde4fbe3e5
    Port:          <none>
    Host Port:     <none>
    Command:
      /bin/bash
    Args:
      -ec
      #!/bin/bash
      source /did-material/did.env
      apt-get -y update; apt-get -y install curl
      curl -X 'POST' 'http://tir.trust-anchor.svc.cluster.local:8080/issuer' -H 'Content-Type: application/json' -d "{\"did\": \"${DID}\", \"credentials\": []}"

    State:          Terminated
      Reason:       Completed
      Exit Code:    0
      Started:      Fri, 08 Nov 2024 19:20:34 +0000
      Finished:     Fri, 08 Nov 2024 19:21:21 +0000
    Ready:          True
    Restart Count:  4
    Environment:    <none>
    Mounts:
      /did-material from did-material (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-nqxlx (ro)
  register-at-til:
    Container ID:  containerd://ff98f99f07001149c0209b06547f87d95bb9725eedbe8f40c71f1c70bf85cb15
    Image:         quay.io/curl/curl:8.1.2
    Image ID:      quay.io/curl/curl@sha256:41dbfe699c12d9e2fba25f9015e6e20a7c360468ce7c7b51c6fdd416d4e32e3f
    Port:          <none>
    Host Port:     <none>
    Command:
      /bin/sh
    Args:
      -ec
      #!/bin/sh
      export $(cat /did-material/did.env)
      /bin/init.sh

    State:          Waiting
      Reason:       CrashLoopBackOff
    Last State:     Terminated
      Reason:       Error
      Exit Code:    6
      Started:      Fri, 08 Nov 2024 19:32:33 +0000
      Finished:     Fri, 08 Nov 2024 19:32:38 +0000
    Ready:          False
    Restart Count:  7
    Environment:    <none>
    Mounts:
      /bin/init.sh from consumer-til-registration (rw,path="init.sh")
      /did-material from did-material (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-nqxlx (ro)
Containers:
  keycloak:
    Container ID:  
    Image:         quay.io/wi_stefan/keycloak:25.0.0-PRE
    Image ID:      
    Ports:         8080/TCP, 7800/TCP
    Host Ports:    0/TCP, 0/TCP
    Command:
      /bin/bash
    Args:
      -ec
      #!/bin/sh
      export $(cat /did-material/did.env)
      export KC_HOSTNAME=keycloak-consumer.127.0.0.1.nip.io
      env | grep DID
      /opt/keycloak/bin/kc.sh start --features oid4vc-vci --import-realm

    State:          Waiting
      Reason:       PodInitializing
    Ready:          False
    Restart Count:  0
    Limits:
      cpu:                750m
      ephemeral-storage:  1Gi
      memory:             768Mi
    Requests:
      cpu:                500m
      ephemeral-storage:  50Mi
      memory:             512Mi
    Liveness:             http-get http://:http/ delay=300s timeout=5s period=1s #success=1 #failure=3
    Readiness:            http-get http://:http/realms/master delay=30s timeout=1s period=10s #success=1 #failure=3
    Environment Variables from:
      consumer-keycloak-env-vars  ConfigMap  Optional: false
    Environment:
      KUBERNETES_NAMESPACE:                                consumer (v1:metadata.namespace)
      BITNAMI_DEBUG:                                       false
      KEYCLOAK_ADMIN_PASSWORD:                             <set to the key 'keycloak-admin' in secret 'issuance-secret'>   Optional: false
      KEYCLOAK_DATABASE_PASSWORD:                          <set to the key 'db-password' in secret 'consumer-externaldb'>  Optional: false
      KEYCLOAK_HTTP_RELATIVE_PATH:                         /
      KC_PROXY:                                            edge
      QUARKUS_TRANSACTION_MANAGER_OBJECT_STORE_DIRECTORY:  /qtm-tmp
      KC_DB_URL_HOST:                                      postgresql
      KC_DB_URL_DATABASE:                                  keycloak
      KC_DB_USERNAME:                                      postgres
      KC_DB_PASSWORD:                                      <set to the key 'postgres-admin-password' in secret 'database-secret'>  Optional: false
      STORE_PASS:                                          <set to the key 'store-pass' in secret 'issuance-secret'>               Optional: false
      KC_ADMIN_PASSWORD:                                   <set to the key 'keycloak-admin' in secret 'issuance-secret'>           Optional: false
    Mounts:
      /did-material from did-material (rw)
      /etc/env from did-material (ro)
      /opt/bitnami/keycloak/conf from empty-dir (rw,path="app-conf-dir")
      /opt/bitnami/keycloak/data from empty-dir (rw,path="app-data-dir")
      /opt/bitnami/keycloak/lib/quarkus from empty-dir (rw,path="app-quarkus-dir")
      /opt/keycloak/data/import from realms (rw)
      /opt/keycloak/lib/quarkus from empty-dir (rw,path="app-quarkus-dir")
      /qtm-tmp from qtm-temp (rw)
      /tmp from empty-dir (rw,path="tmp-dir")
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-nqxlx (ro)
Conditions:
  Type                        Status
  PodReadyToStartContainers   True 
  Initialized                 False 
  Ready                       False 
  ContainersReady             False 
  PodScheduled                True 
Volumes:
  empty-dir:
    Type:       EmptyDir (a temporary directory that shares a pod's lifetime)
    Medium:     
    SizeLimit:  <unset>
  did-material:
    Type:       EmptyDir (a temporary directory that shares a pod's lifetime)
    Medium:     
    SizeLimit:  <unset>
  qtm-temp:
    Type:       EmptyDir (a temporary directory that shares a pod's lifetime)
    Medium:     
    SizeLimit:  <unset>
  realms:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      test-realm-realm
    Optional:  false
  consumer-til-registration:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      consumer-til-registration
    Optional:  false
  kube-api-access-nqxlx:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   Burstable
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason     Age                 From               Message
  ----     ------     ----                ----               -------
  Normal   Scheduled  20m                 default-scheduler  Successfully assigned consumer/consumer-keycloak-0 to k3s
  Normal   Pulling    20m                 kubelet            Pulling image "quay.io/wi_stefan/keycloak:25.0.0-PRE"
  Normal   Pulled     19m                 kubelet            Successfully pulled image "quay.io/wi_stefan/keycloak:25.0.0-PRE" in 1m5.611s (1m5.611s including waiting). Image size: 241562984 bytes.
  Normal   Created    19m                 kubelet            Created container read-only-workaround
  Normal   Started    19m                 kubelet            Started container read-only-workaround
  Normal   Pulling    19m                 kubelet            Pulling image "ubuntu"
  Normal   Pulled     19m                 kubelet            Successfully pulled image "ubuntu" in 4.315s (4.315s including waiting). Image size: 29759772 bytes.
  Normal   Started    19m                 kubelet            Started container get-did
  Normal   Created    19m                 kubelet            Created container get-did
  Normal   Pulled     18m                 kubelet            Successfully pulled image "ubuntu" in 4.252s (4.252s including waiting). Image size: 29759772 bytes.
  Normal   Pulled     17m                 kubelet            Successfully pulled image "ubuntu" in 4.211s (4.211s including waiting). Image size: 29759772 bytes.
  Normal   Pulled     16m                 kubelet            Successfully pulled image "ubuntu" in 3.71s (3.71s including waiting). Image size: 29759772 bytes.
  Normal   Started    16m (x3 over 18m)   kubelet            Started container register-at-tir
  Warning  BackOff    15m (x3 over 16m)   kubelet            Back-off restarting failed container register-at-tir in pod consumer-keycloak-0_consumer(0aa56a24-cbbb-4fc6-8e1f-ac8b71f02e19)
  Normal   Pulling    15m (x4 over 18m)   kubelet            Pulling image "ubuntu"
  Normal   Created    15m (x4 over 18m)   kubelet            Created container register-at-tir
  Normal   Pulled     15m                 kubelet            Successfully pulled image "ubuntu" in 3.336s (3.336s including waiting). Image size: 29759772 bytes.
  Warning  BackOff    29s (x56 over 13m)  kubelet            Back-off restarting failed container register-at-til in pod consumer-keycloak-0_consumer(0aa56a24-cbbb-4fc6-8e1f-ac8b71f02e19)

ubuntu@fiware:~/fiware/data-space-connector$ kubectl logs consumer-keycloak -n consumer
error: error from server (NotFound): pods "consumer-keycloak" not found in namespace "consumer"
ubuntu@fiware:~/fiware/data-space-connector$ mvn clean deploy -Plocal
[INFO] Scanning for projects...
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for org.fiware.dataspace:it:jar:0.0.1
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-compiler-plugin is missing. @ line 164, column 21
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ line 187, column 29
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-deploy-plugin is missing. @ org.fiware.dataspace:connector:0.0.1, /home/ubuntu/fiware/data-space-connector/pom.xml, line 110, column 21
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for org.fiware.dataspace:connector:pom:0.0.1
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-compiler-plugin is missing. @ line 311, column 29
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ line 118, column 21
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-deploy-plugin is missing. @ line 110, column 21
[WARNING] 
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING] 
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING] 
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO] 
[INFO] connector                                                          [pom]
[INFO] it                                                                 [jar]
[INFO] 
[INFO] -------------------< org.fiware.dataspace:connector >-------------------
[INFO] Building connector 0.0.1                                           [1/2]
[INFO] --------------------------------[ pom ]---------------------------------
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ connector ---
[INFO] 
[INFO] --- maven-resources-plugin:3.3.1:copy-resources (copy-resources-trust-anchor) @ connector ---
[INFO] Copying 5 resources from charts/trust-anchor to target/charts/trust-anchor
[INFO] 
[INFO] --- maven-resources-plugin:3.3.1:copy-resources (copy-resources-dsc) @ connector ---
[INFO] Copying 28 resources from charts to target/charts
[INFO] 
[INFO] --- maven-resources-plugin:3.3.1:copy-resources (copy-resources-namespaces) @ connector ---
[INFO] Copying 5 resources from k3s/namespaces to target/k3s/namespaces
[INFO] 
[INFO] --- maven-resources-plugin:3.3.1:copy-resources (copy-resources-infra) @ connector ---
[INFO] Copying 6 resources from k3s/infra to target/k3s/infra
[INFO] 
[INFO] --- helm-maven-plugin:6.13.0:init (template-dsc-provider) @ connector ---
[INFO] Initializing Helm...
[INFO] Creating output directory...
[INFO] Use 3.16.2 as helm version
[INFO] Adding repo [HelmRepository(name=stable, url=https://charts.helm.sh/stable, forceUpdate=false)]
[INFO] "stable" already exists with the same configuration, skipping
[INFO] 
[INFO] --- helm-maven-plugin:6.13.0:dependency-update (template-dsc-provider) @ connector ---
[INFO] Updating chart dependencies for /home/ubuntu/fiware/data-space-connector/target/charts/data-space-connector ...
[INFO] Getting updates for unmanaged Helm repositories...
[INFO] ...Successfully got an update from the "https://fiware.github.io/helm-charts" chart repository
[INFO] ...Successfully got an update from the "https://fiware.github.io/helm-charts" chart repository
[INFO] ...Successfully got an update from the "https://fiware.github.io/helm-charts" chart repository
[INFO] ...Successfully got an update from the "https://fiware.github.io/helm-charts" chart repository
[INFO] ...Successfully got an update from the "https://fiware.github.io/helm-charts" chart repository
[INFO] ...Successfully got an update from the "https://fiware.github.io/helm-charts" chart repository
[INFO] ...Successfully got an update from the "https://fiware.github.io/helm-charts" chart repository
[INFO] ...Successfully got an update from the "https://charts.bitnami.com/bitnami" chart repository
[INFO] ...Successfully got an update from the "https://charts.bitnami.com/bitnami" chart repository
[INFO] Hang tight while we grab the latest from your chart repositories...
[INFO] ...Successfully got an update from the "stable" chart repository
[INFO] Update Complete. ⎈Happy Helming!⎈
[INFO] Saving 12 charts
[INFO] Downloading postgresql from repo oci://registry-1.docker.io/bitnamicharts
[ERROR] Pulled: registry-1.docker.io/bitnamicharts/postgresql:13.1.5
[ERROR] Digest: sha256:b4c742976290356be9c3483f1abddbc4c7ed8a16d80692901a07385133ff0899
[INFO] Downloading vcverifier from repo https://fiware.github.io/helm-charts
[INFO] Downloading credentials-config-service from repo https://fiware.github.io/helm-charts
[INFO] Downloading trusted-issuers-list from repo https://fiware.github.io/helm-charts
[INFO] Downloading mysql from repo https://charts.bitnami.com/bitnami
[INFO] Downloading odrl-pap from repo https://fiware.github.io/helm-charts
[INFO] Downloading apisix from repo oci://registry-1.docker.io/bitnamicharts
[ERROR] Pulled: registry-1.docker.io/bitnamicharts/apisix:3.5.1
[ERROR] Digest: sha256:1667bd749de452c81bbe6fe29de4ed91a08d6ab7350a575783d8bbf950fecbfd
[INFO] Downloading scorpio-broker-aaio from repo https://fiware.github.io/helm-charts
[INFO] Downloading postgresql from repo oci://registry-1.docker.io/bitnamicharts
[ERROR] Pulled: registry-1.docker.io/bitnamicharts/postgresql:13.1.5
[ERROR] Digest: sha256:b4c742976290356be9c3483f1abddbc4c7ed8a16d80692901a07385133ff0899
[INFO] Downloading keycloak from repo https://charts.bitnami.com/bitnami
[INFO] Downloading tm-forum-api from repo https://fiware.github.io/helm-charts
[INFO] Downloading contract-management from repo https://fiware.github.io/helm-charts
[INFO] Deleting outdated charts
[INFO] 
[INFO] --- helm-maven-plugin:6.13.0:template (template-dsc-provider) @ connector ---
[INFO] 

Perform template for chart /home/ubuntu/fiware/data-space-connector/target/charts/data-space-connector...
[WARNING] NOTE: <additionalArguments> option will be removed in future major release.
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/charts/etcd/templates/networkpolicy.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/control-plane/networkpolicy.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/dashboard/networkpolicy.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/data-plane/networkpolicy.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/charts/etcd/templates/pdb.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/control-plane/pdb.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/dashboard/pdb.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/data-plane/pdb.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/ingress-controller/pdb.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/charts/etcd/templates/serviceaccount.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/control-plane/service-account.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/dashboard/service-account.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/data-plane/service-account.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/ingress-controller/service-account.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/mysql/templates/serviceaccount.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/charts/etcd/templates/token-secrets.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/control-plane/api-token-secret.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/dashboard/secret.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/tls-secret.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/tls-secret.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/tls-secret.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/templates/authentication-secrets.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/templates/data-plane-secrets.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/templates/database-secrets.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/templates/issuance-secrets.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/control-plane/configmap.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/dashboard/configmap.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/data-plane/configmap.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/data-plane/extra-configmap.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/contract-management/templates/configmap.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/mysql/templates/primary/configmap.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/mysql/templates/primary/initialization-configmap.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/postgis/templates/primary/initialization-configmap.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/postgresql/templates/primary/initialization-configmap.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/envoy-configmap.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/vcverifier/templates/configmap.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/templates/apisix-cm.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/templates/dataplane-registration.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/templates/dsconfig-cm.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/templates/opa-cm.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/templates/opa.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/templates/realm.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/templates/tmf-registration-cm.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/control-plane/clusterroles.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/data-plane/clusterroles.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/control-plane/clusterrolebinding.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/data-plane/clusterrolebinding.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/charts/etcd/templates/svc-headless.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/charts/etcd/templates/svc.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/control-plane/service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/dashboard/service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/data-plane/service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/contract-management/templates/service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/credentials-config-service/templates/service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/mysql/templates/primary/svc-headless.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/mysql/templates/primary/svc.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/odrl-pap/templates/service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/postgis/templates/primary/svc-headless.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/postgis/templates/primary/svc.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/postgresql/templates/primary/svc-headless.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/postgresql/templates/primary/svc.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/scorpio/templates/service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/envoy-service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/trusted-issuers-list/templates/service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/vcverifier/templates/service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/templates/did-key-service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/templates/dsconfig-service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/control-plane/dep-ds.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/dashboard/deployment.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/data-plane/dep-ds.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/contract-management/templates/deployment.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/credentials-config-service/templates/deployment.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/odrl-pap/templates/deployment.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/scorpio/templates/deployment.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/deployment.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/deployment.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/deployment.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/deployment.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/deployment.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/deployment.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/deployment.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/deployment.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/deployment.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/deployment.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/envoy.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/trusted-issuers-list/templates/deployment.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/vcverifier/templates/deployment.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/templates/did-key-deployment.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/templates/dsconfig-deployment.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/charts/etcd/templates/statefulset.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/mysql/templates/primary/statefulset.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/postgis/templates/primary/statefulset.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/postgresql/templates/primary/statefulset.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/templates/tmf-registration-job.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/apisix/templates/data-plane/ingress.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/odrl-pap/templates/ingress.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/scorpio/templates/ingress.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/tm-forum-api/templates/ingress.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/trusted-issuers-list/templates/ingress-til.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/charts/vcverifier/templates/ingress.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-provider/data-space-connector/templates/did-key-ingress.yaml
[INFO] 
[INFO] 
[INFO] --- helm-maven-plugin:6.13.0:init (template-dsc-consumer) @ connector ---
[INFO] Initializing Helm...
[INFO] Found helm executable, skip init.
[INFO] Adding repo [HelmRepository(name=stable, url=https://charts.helm.sh/stable, forceUpdate=false)]
[INFO] "stable" already exists with the same configuration, skipping
[INFO] 
[INFO] --- helm-maven-plugin:6.13.0:dependency-update (template-dsc-consumer) @ connector ---
[INFO] Updating chart dependencies for /home/ubuntu/fiware/data-space-connector/target/charts/data-space-connector ...
[INFO] Getting updates for unmanaged Helm repositories...
[INFO] ...Successfully got an update from the "https://fiware.github.io/helm-charts" chart repository
[INFO] ...Successfully got an update from the "https://fiware.github.io/helm-charts" chart repository
[INFO] ...Successfully got an update from the "https://fiware.github.io/helm-charts" chart repository
[INFO] ...Successfully got an update from the "https://fiware.github.io/helm-charts" chart repository
[INFO] ...Successfully got an update from the "https://fiware.github.io/helm-charts" chart repository
[INFO] ...Successfully got an update from the "https://fiware.github.io/helm-charts" chart repository
[INFO] ...Successfully got an update from the "https://fiware.github.io/helm-charts" chart repository
[INFO] ...Successfully got an update from the "https://charts.bitnami.com/bitnami" chart repository
[INFO] ...Successfully got an update from the "https://charts.bitnami.com/bitnami" chart repository
[INFO] Hang tight while we grab the latest from your chart repositories...
[INFO] ...Successfully got an update from the "stable" chart repository
[INFO] Update Complete. ⎈Happy Helming!⎈
[INFO] Saving 12 charts
[INFO] Downloading postgresql from repo oci://registry-1.docker.io/bitnamicharts
[ERROR] Pulled: registry-1.docker.io/bitnamicharts/postgresql:13.1.5
[ERROR] Digest: sha256:b4c742976290356be9c3483f1abddbc4c7ed8a16d80692901a07385133ff0899
[INFO] Downloading vcverifier from repo https://fiware.github.io/helm-charts
[INFO] Downloading credentials-config-service from repo https://fiware.github.io/helm-charts
[INFO] Downloading trusted-issuers-list from repo https://fiware.github.io/helm-charts
[INFO] Downloading mysql from repo https://charts.bitnami.com/bitnami
[INFO] Downloading odrl-pap from repo https://fiware.github.io/helm-charts
[INFO] Downloading apisix from repo oci://registry-1.docker.io/bitnamicharts
[ERROR] Pulled: registry-1.docker.io/bitnamicharts/apisix:3.5.1
[ERROR] Digest: sha256:1667bd749de452c81bbe6fe29de4ed91a08d6ab7350a575783d8bbf950fecbfd
[INFO] Downloading scorpio-broker-aaio from repo https://fiware.github.io/helm-charts
[INFO] Downloading postgresql from repo oci://registry-1.docker.io/bitnamicharts
[ERROR] Pulled: registry-1.docker.io/bitnamicharts/postgresql:13.1.5
[ERROR] Digest: sha256:b4c742976290356be9c3483f1abddbc4c7ed8a16d80692901a07385133ff0899
[INFO] Downloading keycloak from repo https://charts.bitnami.com/bitnami
[INFO] Downloading tm-forum-api from repo https://fiware.github.io/helm-charts
[INFO] Downloading contract-management from repo https://fiware.github.io/helm-charts
[INFO] Deleting outdated charts
[INFO] 
[INFO] --- helm-maven-plugin:6.13.0:template (template-dsc-consumer) @ connector ---
[INFO] 

Perform template for chart /home/ubuntu/fiware/data-space-connector/target/charts/data-space-connector...
[WARNING] NOTE: <additionalArguments> option will be removed in future major release.
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/charts/keycloak/templates/networkpolicy.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/charts/keycloak/templates/serviceaccount.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/charts/keycloak/templates/secret-external-db.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/templates/authentication-secrets.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/templates/data-plane-secrets.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/templates/database-secrets.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/templates/issuance-secrets.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/charts/keycloak/templates/configmap-env-vars.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/charts/postgresql/templates/primary/initialization-configmap.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/templates/apisix-cm.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/templates/opa-cm.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/templates/opa.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/templates/participant-registration.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/templates/realm.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/charts/keycloak/templates/headless-service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/charts/keycloak/templates/service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/charts/postgresql/templates/primary/svc-headless.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/charts/postgresql/templates/primary/svc.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/templates/did-key-service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/templates/did-key-deployment.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/charts/keycloak/templates/statefulset.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/charts/postgresql/templates/primary/statefulset.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/charts/keycloak/templates/ingress.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/dsc-consumer/data-space-connector/templates/did-key-ingress.yaml
[INFO] 
[INFO] 
[INFO] --- helm-maven-plugin:6.13.0:init (template-trust-anchor) @ connector ---
[INFO] Initializing Helm...
[INFO] Found helm executable, skip init.
[INFO] Adding repo [HelmRepository(name=stable, url=https://charts.helm.sh/stable, forceUpdate=false)]
[INFO] "stable" already exists with the same configuration, skipping
[INFO] 
[INFO] --- helm-maven-plugin:6.13.0:dependency-update (template-trust-anchor) @ connector ---
[INFO] Updating chart dependencies for /home/ubuntu/fiware/data-space-connector/target/charts/trust-anchor ...
[INFO] Getting updates for unmanaged Helm repositories...
[INFO] ...Successfully got an update from the "https://fiware.github.io/helm-charts" chart repository
[INFO] ...Successfully got an update from the "https://charts.bitnami.com/bitnami" chart repository
[INFO] Hang tight while we grab the latest from your chart repositories...
[INFO] ...Successfully got an update from the "stable" chart repository
[INFO] Update Complete. ⎈Happy Helming!⎈
[INFO] Saving 2 charts
[INFO] Downloading trusted-issuers-list from repo https://fiware.github.io/helm-charts
[INFO] Downloading mysql from repo https://charts.bitnami.com/bitnami
[INFO] Deleting outdated charts
[INFO] 
[INFO] --- helm-maven-plugin:6.13.0:template (template-trust-anchor) @ connector ---
[INFO] 

Perform template for chart /home/ubuntu/fiware/data-space-connector/target/charts/trust-anchor...
[WARNING] NOTE: <additionalArguments> option will be removed in future major release.
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/trust-anchor/trust-anchor/charts/mysql/templates/serviceaccount.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/trust-anchor/trust-anchor/templates/secrets.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/trust-anchor/trust-anchor/charts/mysql/templates/primary/configmap.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/trust-anchor/trust-anchor/charts/mysql/templates/primary/initialization-configmap.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/trust-anchor/trust-anchor/charts/mysql/templates/primary/svc-headless.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/trust-anchor/trust-anchor/charts/mysql/templates/primary/svc.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/trust-anchor/trust-anchor/charts/trusted-issuers-list/templates/service.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/trust-anchor/trust-anchor/charts/trusted-issuers-list/templates/deployment.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/trust-anchor/trust-anchor/charts/mysql/templates/primary/statefulset.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/trust-anchor/trust-anchor/charts/trusted-issuers-list/templates/ingress-til.yaml
[INFO] wrote /home/ubuntu/fiware/data-space-connector/target/k3s/trust-anchor/trust-anchor/charts/trusted-issuers-list/templates/ingress-tir.yaml
[INFO] 
[INFO] 
[INFO] --- maven-failsafe-plugin:3.0.0:integration-test (test) @ connector ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-failsafe-plugin:3.0.0:verify (verify) @ connector ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-install-plugin:3.1.1:install (default-install) @ connector ---
[INFO] Installing /home/ubuntu/fiware/data-space-connector/pom.xml to /home/ubuntu/.m2/repository/org/fiware/dataspace/connector/0.0.1/connector-0.0.1.pom
[INFO] 
[INFO] --- maven-deploy-plugin:2.7:deploy (default-deploy) @ connector ---
[INFO] Skipping artifact deployment
[INFO] 
[INFO] --- k3s-maven-plugin:1.3.0:run (create-namespaces) @ connector ---
[WARNING] Using image tag 'latest' is unstable.
[INFO] k3s server --node-name=k3s --https-listen-port=6443 --disable-cloud-controller --disable-network-policy --disable=metrics-server --disable-helm-controller --disable=local-storage --disable=traefik
[INFO] k3s ready: KUBECONFIG=/home/ubuntu/fiware/data-space-connector/target/k3s.yaml kubectl get all --all-namespaces
[INFO] 
[INFO] --- k3s-maven-plugin:1.3.0:apply (create-namespaces) @ connector ---
[INFO] 
[INFO] No service account found, waiting for sa ...
[INFO] Service account found, continue ...
[INFO] 
[INFO] kubectl apply --filename=/tmp/manifests --recursive
[INFO] deployment kube-system/coredns ... ready
[INFO] 
[INFO] --- k3s-maven-plugin:1.3.0:apply (apply-participants) @ connector ---
[INFO] kubectl apply --filename=/tmp/manifests --recursive
[INFO] deployment provider/dsconfig ... ready
[INFO] statefulset consumer/postgresql ... ready
[INFO] deployment provider/provider-contract-management ... ready
[INFO] deployment provider/provider-tm-forum-api-party-catalog ... ready
[INFO] deployment provider/provider-tm-forum-api-customer-management ... ready
[INFO] pod provider/provider-tm-forum-api-product-ordering-management-6dc78777p9f5p ... ready
[INFO] deployment provider/provider-tm-forum-api-product-ordering-management ... ready
[INFO] deployment provider/provider-tm-forum-api-customer-bill-management ... ready
[INFO] deployment provider/provider-tm-forum-api-product-inventory ... ready
[INFO] statefulset provider/provider-etcd ... ready
[INFO] statefulset provider/data-service-postgis ... ready
[INFO] deployment provider/provider-tm-forum-api-resource-inventory ... ready
[INFO] deployment provider/odrl-pap ... ready
[INFO] deployment kube-system/coredns ... ready
[INFO] deployment provider/provider-tm-forum-api-resource-catalog ... ready
[INFO] pod provider/provider-tm-forum-api-resource-function-activation-59f9f44nthgg ... ready
[INFO] statefulset provider/postgresql ... ready
[INFO] deployment provider/provider-tm-forum-api-service-catalog ... ready
[INFO] deployment provider/provider-apisix-control-plane ... ready
[INFO] deployment provider/provider-tm-forum-api-envoy ... ready
[INFO] deployment infra/traefik ... ready
[INFO] deployment provider/provider-tm-forum-api-resource-function-activation ... ready
[INFO] deployment provider/did-helper ... ready
[INFO] deployment provider/provider-apisix-dashboard ... ready
[INFO] deployment consumer/did-helper ... ready
[INFO] deployment provider/provider-tm-forum-api-product-catalog ... ready
[INFO] deployment provider/provider-apisix-data-plane ... ready
[INFO] Still waiting for: [consumer/consumer-keycloak, provider/authentication-mysql, provider/credentials-config-service, provider/data-service-scorpio, provider/tmf-api-registration, provider/trusted-issuers-list, provider/verifier, trust-anchor/tir, trust-anchor/trust-anchor-mysql]
[INFO] statefulset trust-anchor/trust-anchor-mysql ... ready
[INFO] Still waiting for: [consumer/consumer-keycloak, provider/authentication-mysql, provider/credentials-config-service, provider/data-service-scorpio, provider/tmf-api-registration, provider/trusted-issuers-list, provider/verifier, trust-anchor/tir]
[INFO] statefulset provider/authentication-mysql ... ready
[INFO] Still waiting for: [consumer/consumer-keycloak, provider/credentials-config-service, provider/data-service-scorpio, provider/tmf-api-registration, provider/trusted-issuers-list, provider/verifier, trust-anchor/tir]
[INFO] deployment provider/credentials-config-service ... ready
[INFO] deployment provider/trusted-issuers-list ... ready
[INFO] deployment trust-anchor/tir ... ready
[INFO] Still waiting for: [consumer/consumer-keycloak, provider/data-service-scorpio, provider/tmf-api-registration, provider/verifier]
[INFO] job provider/tmf-api-registration ... ready
[INFO] Still waiting for: [consumer/consumer-keycloak, provider/data-service-scorpio, provider/verifier]
[INFO] deployment provider/verifier ... ready
[INFO] Still waiting for: [consumer/consumer-keycloak, provider/data-service-scorpio]
[INFO] deployment provider/data-service-scorpio ... ready
[INFO] Still waiting for: [consumer/consumer-keycloak]
[ERROR] >>> docker exec k3s-maven-plugin kubectl rollout status statefulset consumer-keycloak --namespace=consumer --timeout=500s (timeout: PT8M30S)
[ERROR] <<< Waiting for 1 pods to be ready...
[ERROR] <<< error: timed out waiting for the condition
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for connector 0.0.1:
[INFO] 
[INFO] connector .......................................... FAILURE [16:19 min]
[INFO] it ................................................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  16:19 min
[INFO] Finished at: 2024-11-08T19:24:48Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal io.kokuwa.maven:k3s-maven-plugin:1.3.0:apply (apply-participants) on project connector: Failed to wait for resources, see previous log -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
wistefan commented 4 days ago

@hokonohara There was actually an issue with the configuration of Keycloak. The latest changes should have solved that, can you please retry?

hokonohara commented 6 hours ago

git pull, retry several times. unfortunately still error.

    :
    :
    :
[INFO] deployment provider/dsconfig ... ready
[INFO] deployment provider/provider-tm-forum-api-resource-function-activation ... ready
[INFO] deployment provider/provider-tm-forum-api-resource-inventory ... ready
[INFO] deployment provider/provider-tm-forum-api-envoy ... ready
[INFO] deployment consumer/did-helper ... ready
[INFO] pod provider/provider-tm-forum-api-resource-function-activation-59f9f44sqrtr ... ready
[INFO] Still waiting for: [consumer/consumer-keycloak, provider/odrl-pap, provider/provider-apisix-control-plane, provider/provider-etcd, provider/tmf-api-registration, provider/trusted-issuers-list, provider/verifier, trust-anchor/tir]
[ERROR] >>> docker exec k3s-maven-plugin kubectl rollout status deployment tir --namespace=trust-anchor --timeout=500s (timeout: PT8M30S)
[ERROR] <<< Waiting for deployment "tir" rollout to finish: 0 of 1 updated replicas are available...
[ERROR] <<< error: timed out waiting for the condition
[ERROR] >>> docker exec k3s-maven-plugin kubectl rollout status statefulset provider-etcd --namespace=provider --timeout=500s (timeout: PT8M30S)
[ERROR] <<< Waiting for 3 pods to be ready...
[ERROR] <<< error: timed out waiting for the condition
[ERROR] >>> docker exec k3s-maven-plugin kubectl rollout status deployment odrl-pap --namespace=provider --timeout=500s (timeout: PT8M30S)
[ERROR] <<< Waiting for deployment "odrl-pap" rollout to finish: 0 of 1 updated replicas are available...
[ERROR] <<< error: timed out waiting for the condition
[ERROR] >>> docker exec k3s-maven-plugin kubectl rollout status statefulset consumer-keycloak --namespace=consumer --timeout=500s (timeout: PT8M30S)
[ERROR] <<< Waiting for 1 pods to be ready...
[ERROR] <<< error: timed out waiting for the condition
[ERROR] >>> docker exec k3s-maven-plugin kubectl rollout status deployment trusted-issuers-list --namespace=provider --timeout=500s (timeout: PT8M30S)
[ERROR] <<< Waiting for deployment "trusted-issuers-list" rollout to finish: 0 of 1 updated replicas are available...
[ERROR] <<< error: timed out waiting for the condition
[INFO] Still waiting for: [provider/provider-apisix-control-plane, provider/tmf-api-registration, provider/verifier]
[ERROR] >>> docker exec k3s-maven-plugin kubectl rollout status deployment provider-apisix-control-plane --namespace=provider --timeout=500s (timeout: PT8M30S)
[ERROR] <<< Waiting for deployment "provider-apisix-control-plane" rollout to finish: 0 of 1 updated replicas are available...
[ERROR] <<< error: timed out waiting for the condition
[ERROR] >>> docker exec k3s-maven-plugin kubectl wait --for=condition=complete job tmf-api-registration --namespace=provider --timeout=500s (timeout: PT8M30S)
[ERROR] <<< error: timed out waiting for the condition on jobs/tmf-api-registration
[INFO] Still waiting for: [provider/verifier]
[ERROR] >>> docker exec k3s-maven-plugin kubectl rollout status deployment verifier --namespace=provider --timeout=500s (timeout: PT8M30S)
[ERROR] <<< Waiting for deployment "verifier" rollout to finish: 0 of 1 updated replicas are available...
[ERROR] <<< error: deployment "verifier" exceeded its progress deadline
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for connector 0.0.1:
[INFO] 
[INFO] connector .......................................... FAILURE [11:50 min]
[INFO] it ................................................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  11:50 min
[INFO] Finished at: 2024-11-25T22:21:25Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal io.kokuwa.maven:k3s-maven-plugin:1.3.0:apply (apply-participants) on project connector: Failed to wait for resources, see previous log -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException

$ kubectl get all --all-namespaces

NAMESPACE      NAME                                                                  READY   STATUS                  RESTARTS          AGE
consumer       pod/consumer-keycloak-0                                               0/1     Init:1/4                77 (5m46s ago)    11h
consumer       pod/did-helper-7bf56b686f-7246x                                       1/1     Running                 0                 11h
consumer       pod/postgresql-0                                                      1/1     Running                 0                 11h
infra          pod/traefik-699bb489cc-5lncm                                          1/1     Running                 0                 11h
kube-system    pod/coredns-b5657867f-slssn                                           1/1     Running                 0                 11h
kube-system    pod/svclb-provider-apisix-data-plane-85dd223f-2prqj                   2/2     Running                 0                 11h
kube-system    pod/svclb-traefik-loadbalancer-b5c17b44-mrmrq                         1/1     Running                 0                 11h
provider       pod/authentication-mysql-0                                            1/1     Running                 0                 11h
provider       pod/credentials-config-service-75ff6d8c98-mwstc                       0/1     CrashLoopBackOff        209 (3m11s ago)   11h
provider       pod/data-service-postgis-0                                            1/1     Running                 0                 11h
provider       pod/data-service-scorpio-68c89fb7f7-z8f4t                             0/1     Init:CrashLoopBackOff   136 (20s ago)     11h
provider       pod/did-helper-588dbf95bf-qrjfh                                       1/1     Running                 0                 11h
provider       pod/dsconfig-644f7fdd-zcr42                                           1/1     Running                 0                 11h
provider       pod/odrl-pap-d56f5db97-d9thp                                          0/1     Init:0/1                77 (7m35s ago)    11h
provider       pod/postgresql-0                                                      1/1     Running                 0                 11h
provider       pod/provider-apisix-control-plane-594f98df-ttw8j                      0/1     Init:Error              99 (7m9s ago)     11h
provider       pod/provider-apisix-data-plane-56bf6bd59f-pd4nm                       0/2     Init:0/2                99 (6m9s ago)     11h
provider       pod/provider-contract-management-5c5c76c997-xtr5w                     1/1     Running                 0                 11h
provider       pod/provider-etcd-0                                                   0/1     Running                 107 (3m10s ago)   11h
provider       pod/provider-etcd-1                                                   0/1     Running                 109 (3m21s ago)   11h
provider       pod/provider-etcd-2                                                   0/1     Running                 107 (3m20s ago)   11h
provider       pod/provider-tm-forum-api-customer-bill-management-998d97ddd-wmw4b    1/1     Running                 0                 11h
provider       pod/provider-tm-forum-api-customer-management-586698485f-c7w52        1/1     Running                 0                 11h
provider       pod/provider-tm-forum-api-envoy-847f4d6cc8-f4pbn                      1/1     Running                 0                 11h
provider       pod/provider-tm-forum-api-party-catalog-797b89d98b-dqzvd              1/1     Running                 0                 11h
provider       pod/provider-tm-forum-api-product-catalog-8658d8c59d-4lshv            1/1     Running                 0                 11h
provider       pod/provider-tm-forum-api-product-inventory-bb5d45c87-twx5x           1/1     Running                 0                 11h
provider       pod/provider-tm-forum-api-product-ordering-management-6dc78777l76m7   1/1     Running                 0                 11h
provider       pod/provider-tm-forum-api-resource-catalog-5fd9bcc997-xwvcj           1/1     Running                 0                 11h
provider       pod/provider-tm-forum-api-resource-function-activation-59f9f44sqrtr   1/1     Running                 0                 11h
provider       pod/provider-tm-forum-api-resource-inventory-548fdbf5b4-25l29         1/1     Running                 0                 11h
provider       pod/provider-tm-forum-api-service-catalog-66c5c89dfd-p4pjl            1/1     Running                 0                 11h
provider       pod/tmf-api-registration-2p2rk                                        0/1     Error                   0                 10h
provider       pod/tmf-api-registration-58697                                        0/1     Error                   0                 11h
provider       pod/tmf-api-registration-5w5n5                                        0/1     Error                   0                 11h
provider       pod/tmf-api-registration-9cxv5                                        0/1     Error                   0                 11h
provider       pod/tmf-api-registration-c6hmn                                        0/1     Error                   0                 10h
provider       pod/tmf-api-registration-f9bff                                        0/1     Error                   0                 10h
provider       pod/tmf-api-registration-gw77p                                        0/1     Error                   0                 11h
provider       pod/tmf-api-registration-lpbzr                                        0/1     Error                   0                 11h
provider       pod/tmf-api-registration-nnl7r                                        0/1     Error                   0                 10h
provider       pod/tmf-api-registration-q4v7j                                        0/1     Error                   0                 11h
provider       pod/tmf-api-registration-zhq4f                                        0/1     Error                   0                 11h
provider       pod/trusted-issuers-list-5d8fb688b7-sw5d7                             0/1     CrashLoopBackOff        174 (4m4s ago)    11h
provider       pod/verifier-95694dc4c-r2wdw                                          0/1     Init:0/2                77 (8m53s ago)    11h
trust-anchor   pod/tir-5fb8c4b6d-wjlt8                                               0/1     CrashLoopBackOff        176 (83s ago)     11h
trust-anchor   pod/trust-anchor-mysql-0                                              1/1     Running                 0                 11h

NAMESPACE      NAME                                                         TYPE           CLUSTER-IP      EXTERNAL-IP   PORT(S)                      AGE
consumer       service/consumer-keycloak                                    ClusterIP      10.43.249.41    <none>        8080/TCP                     11h
consumer       service/consumer-keycloak-headless                           ClusterIP      None            <none>        8080/TCP                     11h
consumer       service/did-helper                                           ClusterIP      10.43.20.7      <none>        3001/TCP                     11h
consumer       service/postgresql                                           ClusterIP      10.43.54.133    <none>        5432/TCP                     11h
consumer       service/postgresql-hl                                        ClusterIP      None            <none>        5432/TCP                     11h
default        service/kubernetes                                           ClusterIP      10.43.0.1       <none>        443/TCP                      11h
infra          service/traefik-admin                                        ClusterIP      10.43.141.188   <none>        80/TCP                       11h
infra          service/traefik-loadbalancer                                 LoadBalancer   10.43.15.100    172.17.0.2    8080:31872/TCP               11h
kube-system    service/kube-dns                                             ClusterIP      10.43.0.10      <none>        53/UDP,53/TCP,9153/TCP       11h
provider       service/authentication-mysql                                 ClusterIP      10.43.193.238   <none>        3306/TCP                     11h
provider       service/authentication-mysql-headless                        ClusterIP      None            <none>        3306/TCP                     11h
provider       service/credentials-config-service                           ClusterIP      10.43.91.241    <none>        8080/TCP                     11h
provider       service/data-service-postgis                                 ClusterIP      10.43.128.148   <none>        5432/TCP                     11h
provider       service/data-service-postgis-hl                              ClusterIP      None            <none>        5432/TCP                     11h
provider       service/data-service-scorpio                                 ClusterIP      10.43.183.87    <none>        9090/TCP                     11h
provider       service/did-helper                                           ClusterIP      10.43.228.57    <none>        3002/TCP                     11h
provider       service/dsconfig                                             ClusterIP      10.43.137.173   <none>        3002/TCP                     11h
provider       service/odrl-pap                                             ClusterIP      10.43.178.115   <none>        8080/TCP                     11h
provider       service/postgresql                                           ClusterIP      10.43.66.250    <none>        5432/TCP                     11h
provider       service/postgresql-hl                                        ClusterIP      None            <none>        5432/TCP                     11h
provider       service/provider-apisix-control-plane                        ClusterIP      10.43.146.131   <none>        9180/TCP,9280/TCP            11h
provider       service/provider-apisix-data-plane                           LoadBalancer   10.43.63.115    172.17.0.2    80:32006/TCP,443:32606/TCP   11h
provider       service/provider-contract-management                         ClusterIP      10.43.138.112   <none>        8080/TCP                     11h
provider       service/provider-etcd                                        ClusterIP      10.43.90.0      <none>        2379/TCP,2380/TCP            11h
provider       service/provider-etcd-headless                               ClusterIP      None            <none>        2379/TCP,2380/TCP            11h
provider       service/provider-tm-forum-api-customer-bill-management       ClusterIP      10.43.139.131   <none>        8080/TCP                     11h
provider       service/provider-tm-forum-api-customer-management            ClusterIP      10.43.195.169   <none>        8080/TCP                     11h
provider       service/provider-tm-forum-api-party-catalog                  ClusterIP      10.43.149.210   <none>        8080/TCP                     11h
provider       service/provider-tm-forum-api-product-catalog                ClusterIP      10.43.178.35    <none>        8080/TCP                     11h
provider       service/provider-tm-forum-api-product-inventory              ClusterIP      10.43.166.219   <none>        8080/TCP                     11h
provider       service/provider-tm-forum-api-product-ordering-management    ClusterIP      10.43.130.0     <none>        8080/TCP                     11h
provider       service/provider-tm-forum-api-resource-catalog               ClusterIP      10.43.225.109   <none>        8080/TCP                     11h
provider       service/provider-tm-forum-api-resource-function-activation   ClusterIP      10.43.76.136    <none>        8080/TCP                     11h
provider       service/provider-tm-forum-api-resource-inventory             ClusterIP      10.43.93.123    <none>        8080/TCP                     11h
provider       service/provider-tm-forum-api-service-catalog                ClusterIP      10.43.241.106   <none>        8080/TCP                     11h
provider       service/tm-forum-api                                         ClusterIP      10.43.34.148    <none>        8080/TCP                     11h
provider       service/trusted-issuers-list                                 ClusterIP      10.43.10.78     <none>        8080/TCP                     11h
provider       service/verifier                                             ClusterIP      10.43.224.53    <none>        3000/TCP                     11h
trust-anchor   service/tir                                                  ClusterIP      10.43.21.117    <none>        8080/TCP                     11h
trust-anchor   service/trust-anchor-mysql                                   ClusterIP      10.43.117.37    <none>        3306/TCP                     11h
trust-anchor   service/trust-anchor-mysql-headless                          ClusterIP      None            <none>        3306/TCP                     11h

NAMESPACE     NAME                                                       DESIRED   CURRENT   READY   UP-TO-DATE   AVAILABLE   NODE SELECTOR   AGE
kube-system   daemonset.apps/svclb-provider-apisix-data-plane-85dd223f   1         1         1       1            1           <none>          11h
kube-system   daemonset.apps/svclb-traefik-loadbalancer-b5c17b44         1         1         1       1            1           <none>          11h

NAMESPACE      NAME                                                                 READY   UP-TO-DATE   AVAILABLE   AGE
consumer       deployment.apps/did-helper                                           1/1     1            1           11h
infra          deployment.apps/traefik                                              1/1     1            1           11h
kube-system    deployment.apps/coredns                                              1/1     1            1           11h
provider       deployment.apps/credentials-config-service                           0/1     1            0           11h
provider       deployment.apps/data-service-scorpio                                 0/1     1            0           11h
provider       deployment.apps/did-helper                                           1/1     1            1           11h
provider       deployment.apps/dsconfig                                             1/1     1            1           11h
provider       deployment.apps/odrl-pap                                             0/1     1            0           11h
provider       deployment.apps/provider-apisix-control-plane                        0/1     1            0           11h
provider       deployment.apps/provider-apisix-data-plane                           0/1     1            0           11h
provider       deployment.apps/provider-contract-management                         1/1     1            1           11h
provider       deployment.apps/provider-tm-forum-api-customer-bill-management       1/1     1            1           11h
provider       deployment.apps/provider-tm-forum-api-customer-management            1/1     1            1           11h
provider       deployment.apps/provider-tm-forum-api-envoy                          1/1     1            1           11h
provider       deployment.apps/provider-tm-forum-api-party-catalog                  1/1     1            1           11h
provider       deployment.apps/provider-tm-forum-api-product-catalog                1/1     1            1           11h
provider       deployment.apps/provider-tm-forum-api-product-inventory              1/1     1            1           11h
provider       deployment.apps/provider-tm-forum-api-product-ordering-management    1/1     1            1           11h
provider       deployment.apps/provider-tm-forum-api-resource-catalog               1/1     1            1           11h
provider       deployment.apps/provider-tm-forum-api-resource-function-activation   1/1     1            1           11h
provider       deployment.apps/provider-tm-forum-api-resource-inventory             1/1     1            1           11h
provider       deployment.apps/provider-tm-forum-api-service-catalog                1/1     1            1           11h
provider       deployment.apps/trusted-issuers-list                                 0/1     1            0           11h
provider       deployment.apps/verifier                                             0/1     1            0           11h
trust-anchor   deployment.apps/tir                                                  0/1     1            0           11h

NAMESPACE      NAME                                                                            DESIRED   CURRENT   READY   AGE
consumer       replicaset.apps/did-helper-7bf56b686f                                           1         1         1       11h
infra          replicaset.apps/traefik-699bb489cc                                              1         1         1       11h
kube-system    replicaset.apps/coredns-b5657867f                                               1         1         1       11h
provider       replicaset.apps/credentials-config-service-75ff6d8c98                           1         1         0       11h
provider       replicaset.apps/data-service-scorpio-68c89fb7f7                                 1         1         0       11h
provider       replicaset.apps/did-helper-588dbf95bf                                           1         1         1       11h
provider       replicaset.apps/dsconfig-644f7fdd                                               1         1         1       11h
provider       replicaset.apps/odrl-pap-d56f5db97                                              1         1         0       11h
provider       replicaset.apps/provider-apisix-control-plane-594f98df                          1         1         0       11h
provider       replicaset.apps/provider-apisix-data-plane-56bf6bd59f                           1         1         0       11h
provider       replicaset.apps/provider-contract-management-5c5c76c997                         1         1         1       11h
provider       replicaset.apps/provider-tm-forum-api-customer-bill-management-998d97ddd        1         1         1       11h
provider       replicaset.apps/provider-tm-forum-api-customer-management-586698485f            1         1         1       11h
provider       replicaset.apps/provider-tm-forum-api-envoy-847f4d6cc8                          1         1         1       11h
provider       replicaset.apps/provider-tm-forum-api-party-catalog-797b89d98b                  1         1         1       11h
provider       replicaset.apps/provider-tm-forum-api-product-catalog-8658d8c59d                1         1         1       11h
provider       replicaset.apps/provider-tm-forum-api-product-inventory-bb5d45c87               1         1         1       11h
provider       replicaset.apps/provider-tm-forum-api-product-ordering-management-6dc7877786    1         1         1       11h
provider       replicaset.apps/provider-tm-forum-api-resource-catalog-5fd9bcc997               1         1         1       11h
provider       replicaset.apps/provider-tm-forum-api-resource-function-activation-59f9f444c8   1         1         1       11h
provider       replicaset.apps/provider-tm-forum-api-resource-inventory-548fdbf5b4             1         1         1       11h
provider       replicaset.apps/provider-tm-forum-api-service-catalog-66c5c89dfd                1         1         1       11h
provider       replicaset.apps/trusted-issuers-list-5d8fb688b7                                 1         1         0       11h
provider       replicaset.apps/verifier-95694dc4c                                              1         1         0       11h
trust-anchor   replicaset.apps/tir-5fb8c4b6d                                                   1         1         0       11h

NAMESPACE      NAME                                    READY   AGE
consumer       statefulset.apps/consumer-keycloak      0/1     11h
consumer       statefulset.apps/postgresql             1/1     11h
provider       statefulset.apps/authentication-mysql   1/1     11h
provider       statefulset.apps/data-service-postgis   1/1     11h
provider       statefulset.apps/postgresql             1/1     11h
provider       statefulset.apps/provider-etcd          0/3     11h
trust-anchor   statefulset.apps/trust-anchor-mysql     1/1     11h

NAMESPACE   NAME                             STATUS   COMPLETIONS   DURATION   AGE
provider    job.batch/tmf-api-registration   Failed   0/1           11h        11h