search

eclipse / packages

IoT Packages project
https://eclipse.org/packages
Eclipse Public License 2.0
46 stars 66 forks source link

Issue installing hono on fresh local kubernetes cluster #154

Closed marcel-bluestone closed 3 years ago

marcel-bluestone commented 3 years ago

Hello, I want to try hone on a local kubernetes cluster, installed on two VMs running plain vanilla ubuntu 20.04.

The cluster is up an running: NAMESPACE NAME READY STATUS RESTARTS AGE kube-system coredns-f9fd979d6-fh7rj 1/1 Running 0 79m kube-system coredns-f9fd979d6-qmlg2 1/1 Running 0 79m kube-system etcd-kubernetes-master 1/1 Running 0 79m kube-system kube-apiserver-kubernetes-master 1/1 Running 0 79m kube-system kube-controller-manager-kubernetes-master 1/1 Running 0 79m kube-system kube-flannel-ds-h945f 1/1 Running 0 75m kube-system kube-flannel-ds-j7ttf 1/1 Running 0 76m kube-system kube-proxy-4x9rn 1/1 Running 0 79m kube-system kube-proxy-rc9t9 1/1 Running 0 75m kube-system kube-scheduler-kubernetes-master 1/1 Running 0 79m

Then the installation via helm then gets stuck in some post-processing steps: $ helm install -v 7 --dependency-update -n hono eclipse-hono eclipse-iot/hono I1027 16:54:40.491299 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:41.903341 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:41.903885 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:41.905133 47587 round_trippers.go:420] GET https://192.168.1.148:6443/version?timeout=32s I1027 16:54:41.905148 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.905273 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.905286 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.911378 47587 round_trippers.go:446] Response Status: 200 OK in 6 milliseconds I1027 16:54:41.912071 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:41.912546 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/secrets?labelSelector=name%3Declipse-hono%2Cowner%3Dhelm I1027 16:54:41.912611 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.912623 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.912634 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.914382 47587 round_trippers.go:446] Response Status: 200 OK in 1 milliseconds I1027 16:54:41.917073 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:41.917302 47587 round_trippers.go:420] GET https://192.168.1.148:6443/version?timeout=32s I1027 16:54:41.917316 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.917324 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.917330 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.917916 47587 round_trippers.go:446] Response Status: 200 OK in 0 milliseconds I1027 16:54:41.927071 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api?timeout=32s I1027 16:54:41.927118 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.927139 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.927146 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.928184 47587 round_trippers.go:446] Response Status: 200 OK in 1 milliseconds I1027 16:54:41.935735 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis?timeout=32s I1027 16:54:41.935874 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.935958 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.936032 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.936996 47587 round_trippers.go:446] Response Status: 200 OK in 0 milliseconds I1027 16:54:41.945770 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/discovery.k8s.io/v1beta1?timeout=32s I1027 16:54:41.946595 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.945821 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/certificates.k8s.io/v1?timeout=32s I1027 16:54:41.945848 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1?timeout=32s I1027 16:54:41.945870 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/apiregistration.k8s.io/v1?timeout=32s I1027 16:54:41.945888 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/apiregistration.k8s.io/v1beta1?timeout=32s I1027 16:54:41.945907 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/extensions/v1beta1?timeout=32s I1027 16:54:41.945932 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/apps/v1?timeout=32s I1027 16:54:41.945951 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/events.k8s.io/v1?timeout=32s I1027 16:54:41.945972 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/events.k8s.io/v1beta1?timeout=32s I1027 16:54:41.945992 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/authentication.k8s.io/v1?timeout=32s I1027 16:54:41.946011 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/authentication.k8s.io/v1beta1?timeout=32s I1027 16:54:41.946030 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/authorization.k8s.io/v1?timeout=32s I1027 16:54:41.946047 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/authorization.k8s.io/v1beta1?timeout=32s I1027 16:54:41.946066 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/autoscaling/v1?timeout=32s I1027 16:54:41.946086 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/autoscaling/v2beta1?timeout=32s I1027 16:54:41.946113 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/autoscaling/v2beta2?timeout=32s I1027 16:54:41.946132 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/batch/v1?timeout=32s I1027 16:54:41.946151 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/batch/v1beta1?timeout=32s I1027 16:54:41.946173 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/admissionregistration.k8s.io/v1?timeout=32s I1027 16:54:41.946190 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/certificates.k8s.io/v1beta1?timeout=32s I1027 16:54:41.946207 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/networking.k8s.io/v1?timeout=32s I1027 16:54:41.946225 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/networking.k8s.io/v1beta1?timeout=32s I1027 16:54:41.946244 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/policy/v1beta1?timeout=32s I1027 16:54:41.946262 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/rbac.authorization.k8s.io/v1?timeout=32s I1027 16:54:41.946280 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/rbac.authorization.k8s.io/v1beta1?timeout=32s I1027 16:54:41.946299 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/storage.k8s.io/v1?timeout=32s I1027 16:54:41.946318 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/storage.k8s.io/v1beta1?timeout=32s I1027 16:54:41.946335 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/scheduling.k8s.io/v1?timeout=32s I1027 16:54:41.946352 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/admissionregistration.k8s.io/v1beta1?timeout=32s I1027 16:54:41.946370 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/apiextensions.k8s.io/v1?timeout=32s I1027 16:54:41.946390 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/apiextensions.k8s.io/v1beta1?timeout=32s I1027 16:54:41.946408 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/coordination.k8s.io/v1?timeout=32s I1027 16:54:41.946430 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/scheduling.k8s.io/v1beta1?timeout=32s I1027 16:54:41.946447 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/coordination.k8s.io/v1beta1?timeout=32s I1027 16:54:41.946471 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/node.k8s.io/v1beta1?timeout=32s I1027 16:54:41.947189 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.947309 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.948341 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.948371 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.947388 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.948618 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.947432 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.947468 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.947499 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.947530 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.947561 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.947592 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.947623 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.947654 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.947685 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.947716 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.947740 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.947764 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.947788 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.947812 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.947836 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.947860 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.947884 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.947910 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.947934 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.947997 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.948023 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.948047 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.948071 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.948095 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.948119 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.948142 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.948166 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.948190 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.948218 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.948243 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.948269 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.948297 47587 round_trippers.go:427] Request Headers: I1027 16:54:41.948324 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.948676 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.949209 47587 round_trippers.go:446] Response Status: 200 OK in 0 milliseconds I1027 16:54:41.949245 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.949279 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.949305 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.949333 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.949358 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.949384 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.949409 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.949435 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.949462 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.949487 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.949513 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.949538 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.949599 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.949626 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.949654 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.949682 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.949707 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.949732 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.949756 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.949782 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.949806 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.949832 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.949856 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.949881 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.949907 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.949932 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.949957 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.949981 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.950007 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.950031 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.950075 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.950103 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.950658 47587 round_trippers.go:446] Response Status: 200 OK in 0 milliseconds I1027 16:54:41.952850 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.952897 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.952931 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.952962 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.952994 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.953024 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.953055 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.953168 47587 round_trippers.go:446] Response Status: 200 OK in 2 milliseconds I1027 16:54:41.953473 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.953523 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.953555 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.953592 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.953626 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.953657 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.953687 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.953718 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.953748 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.953779 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.953814 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.953846 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.953877 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.953907 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.953938 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.953969 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.954000 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.954030 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.954061 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:41.954092 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.954124 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.954157 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.954188 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.954219 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.954250 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:41.957413 47587 round_trippers.go:446] Response Status: 200 OK in 4 milliseconds I1027 16:54:41.960048 47587 round_trippers.go:446] Response Status: 200 OK in 7 milliseconds I1027 16:54:41.960181 47587 round_trippers.go:446] Response Status: 200 OK in 7 milliseconds I1027 16:54:41.960470 47587 round_trippers.go:446] Response Status: 200 OK in 7 milliseconds I1027 16:54:41.960491 47587 round_trippers.go:446] Response Status: 200 OK in 6 milliseconds I1027 16:54:41.960519 47587 round_trippers.go:446] Response Status: 200 OK in 6 milliseconds I1027 16:54:41.960547 47587 round_trippers.go:446] Response Status: 200 OK in 6 milliseconds I1027 16:54:41.960567 47587 round_trippers.go:446] Response Status: 200 OK in 7 milliseconds I1027 16:54:41.960590 47587 round_trippers.go:446] Response Status: 200 OK in 7 milliseconds I1027 16:54:41.964941 47587 round_trippers.go:446] Response Status: 200 OK in 10 milliseconds I1027 16:54:41.965168 47587 round_trippers.go:446] Response Status: 200 OK in 11 milliseconds I1027 16:54:41.965207 47587 round_trippers.go:446] Response Status: 200 OK in 11 milliseconds I1027 16:54:41.965283 47587 round_trippers.go:446] Response Status: 200 OK in 11 milliseconds I1027 16:54:41.965308 47587 round_trippers.go:446] Response Status: 200 OK in 11 milliseconds I1027 16:54:41.965329 47587 round_trippers.go:446] Response Status: 200 OK in 11 milliseconds I1027 16:54:41.965342 47587 round_trippers.go:446] Response Status: 200 OK in 11 milliseconds I1027 16:54:41.965359 47587 round_trippers.go:446] Response Status: 200 OK in 11 milliseconds I1027 16:54:41.965376 47587 round_trippers.go:446] Response Status: 200 OK in 11 milliseconds I1027 16:54:41.965392 47587 round_trippers.go:446] Response Status: 200 OK in 11 milliseconds I1027 16:54:41.965408 47587 round_trippers.go:446] Response Status: 200 OK in 11 milliseconds I1027 16:54:41.965424 47587 round_trippers.go:446] Response Status: 200 OK in 11 milliseconds I1027 16:54:41.965441 47587 round_trippers.go:446] Response Status: 200 OK in 11 milliseconds I1027 16:54:41.965459 47587 round_trippers.go:446] Response Status: 200 OK in 11 milliseconds I1027 16:54:41.965477 47587 round_trippers.go:446] Response Status: 200 OK in 11 milliseconds I1027 16:54:41.965498 47587 round_trippers.go:446] Response Status: 200 OK in 11 milliseconds I1027 16:54:41.965518 47587 round_trippers.go:446] Response Status: 200 OK in 11 milliseconds I1027 16:54:41.965535 47587 round_trippers.go:446] Response Status: 200 OK in 11 milliseconds I1027 16:54:41.965551 47587 round_trippers.go:446] Response Status: 200 OK in 11 milliseconds I1027 16:54:41.965568 47587 round_trippers.go:446] Response Status: 200 OK in 11 milliseconds I1027 16:54:41.965584 47587 round_trippers.go:446] Response Status: 200 OK in 11 milliseconds I1027 16:54:41.965600 47587 round_trippers.go:446] Response Status: 200 OK in 11 milliseconds I1027 16:54:41.965618 47587 round_trippers.go:446] Response Status: 200 OK in 12 milliseconds I1027 16:54:42.193485 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.319815 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.320158 47587 round_trippers.go:420] GET https://192.168.1.148:6443/openapi/v2?timeout=32s I1027 16:54:42.320923 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.320938 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:42.320958 47587 round_trippers.go:431] Accept: application/com.github.proto-openapi.spec.v2@v1.0+protobuf I1027 16:54:42.327838 47587 round_trippers.go:446] Response Status: 200 OK in 6 milliseconds I1027 16:54:42.442490 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.444315 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.449138 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.449819 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.450455 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.451014 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.451538 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.452194 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.453753 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.455321 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.456051 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.457147 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.458248 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.459320 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.460622 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.461804 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.462450 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.463117 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.463751 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.474167 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.476092 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.476907 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.477573 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.478240 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.479012 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.479630 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.480331 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.480993 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.481721 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.482321 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.483005 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.483686 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.484312 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.484966 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.485674 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.486664 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.487916 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.488684 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.489502 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.490263 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.490951 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.491552 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.493043 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.494223 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.495382 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.496353 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.497570 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.498911 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.500095 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.501168 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.502402 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:42.502917 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/policy/v1beta1/podsecuritypolicies/eclipse-hono-grafana I1027 16:54:42.502940 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.502945 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.506297 47587 round_trippers.go:446] Response Status: 404 Not Found in 3 milliseconds I1027 16:54:42.506928 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/policy/v1beta1/podsecuritypolicies/eclipse-hono-grafana-test I1027 16:54:42.507084 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.507215 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.512346 47587 round_trippers.go:446] Response Status: 404 Not Found in 5 milliseconds I1027 16:54:42.512516 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/serviceaccounts/eclipse-hono-grafana I1027 16:54:42.512541 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.512555 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.514323 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.514492 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/serviceaccounts/eclipse-hono-grafana-test I1027 16:54:42.514560 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.514570 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.516041 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.516233 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/serviceaccounts/eclipse-hono-prometheus-server I1027 16:54:42.516273 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.516283 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.517579 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.517681 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/secrets/eclipse-hono-grafana I1027 16:54:42.517688 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.517692 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.519284 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.519392 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/secrets/eclipse-hono-artemis-conf I1027 16:54:42.519398 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.519402 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.520577 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.520672 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/secrets/eclipse-hono-dispatch-router-conf I1027 16:54:42.520678 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.520682 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.521789 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.521879 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/secrets/eclipse-hono-grafana-datasources I1027 16:54:42.521885 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.521889 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.522972 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.523065 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/secrets/eclipse-hono-adapter-amqp-vertx-conf I1027 16:54:42.523072 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.523075 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.524092 47587 round_trippers.go:446] Response Status: 404 Not Found in 0 milliseconds I1027 16:54:42.524177 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/secrets/eclipse-hono-adapter-http-vertx-conf I1027 16:54:42.524183 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.524186 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.525270 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.525359 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/secrets/eclipse-hono-adapter-mqtt-vertx-conf I1027 16:54:42.525365 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.525369 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.526364 47587 round_trippers.go:446] Response Status: 404 Not Found in 0 milliseconds I1027 16:54:42.526461 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/secrets/eclipse-hono-service-auth-conf I1027 16:54:42.526467 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.526471 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.528004 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.528185 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/secrets/eclipse-hono-service-device-registry-conf I1027 16:54:42.528206 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.528215 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.529897 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.530055 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/configmaps/eclipse-hono-grafana-config-dashboards I1027 16:54:42.530065 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.530069 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.531598 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.531735 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/configmaps/eclipse-hono-grafana I1027 16:54:42.531741 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.531745 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.532941 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.533033 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/configmaps/eclipse-hono-grafana-test I1027 16:54:42.533039 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.533042 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.534185 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.534535 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/configmaps/eclipse-hono-grafana-dashboards I1027 16:54:42.534618 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.534654 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.536025 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.536179 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/configmaps/eclipse-hono-post-install-device-registry-conf I1027 16:54:42.536196 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.536201 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.537300 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.537600 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/configmaps/eclipse-hono-prometheus-config I1027 16:54:42.537734 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.537875 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.538886 47587 round_trippers.go:446] Response Status: 404 Not Found in 0 milliseconds I1027 16:54:42.538982 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/persistentvolumeclaims/eclipse-hono-prometheus-server I1027 16:54:42.538998 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.539002 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.540017 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.540102 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/persistentvolumeclaims/eclipse-hono-service-device-registry I1027 16:54:42.540112 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.540118 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.541355 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.541483 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/rbac.authorization.k8s.io/v1beta1/clusterroles/eclipse-hono-prometheus-server I1027 16:54:42.541495 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.541499 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.542559 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.542658 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/rbac.authorization.k8s.io/v1beta1/clusterrolebindings/eclipse-hono-prometheus-server I1027 16:54:42.542664 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.542668 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.544022 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.544179 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/hono/roles/eclipse-hono-grafana I1027 16:54:42.544196 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.544204 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.545687 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.545804 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/rbac.authorization.k8s.io/v1/namespaces/hono/roles/eclipse-hono-grafana-test I1027 16:54:42.545816 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.545820 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.547087 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.547224 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/hono/rolebindings/eclipse-hono-grafana I1027 16:54:42.547232 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.547236 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.548636 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.548734 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/rbac.authorization.k8s.io/v1/namespaces/hono/rolebindings/eclipse-hono-grafana-test I1027 16:54:42.548741 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.548744 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.550148 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.550367 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/services/eclipse-hono-grafana I1027 16:54:42.550389 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.550398 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.552682 47587 round_trippers.go:446] Response Status: 404 Not Found in 2 milliseconds I1027 16:54:42.552872 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/services/eclipse-hono-prometheus-server I1027 16:54:42.552887 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.552895 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.554505 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.554645 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/services/eclipse-hono-artemis I1027 16:54:42.554657 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.554662 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.565556 47587 round_trippers.go:446] Response Status: 404 Not Found in 10 milliseconds I1027 16:54:42.565909 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/services/eclipse-hono-dispatch-router-ext I1027 16:54:42.565969 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.565983 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.567469 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.567650 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/services/eclipse-hono-dispatch-router I1027 16:54:42.567674 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.567685 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.574718 47587 round_trippers.go:446] Response Status: 404 Not Found in 7 milliseconds I1027 16:54:42.574948 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/services/eclipse-hono-adapter-amqp-vertx I1027 16:54:42.574978 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.574992 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.577870 47587 round_trippers.go:446] Response Status: 404 Not Found in 2 milliseconds I1027 16:54:42.578039 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/services/eclipse-hono-adapter-http-vertx I1027 16:54:42.578085 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.578125 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.580749 47587 round_trippers.go:446] Response Status: 404 Not Found in 2 milliseconds I1027 16:54:42.580919 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/services/eclipse-hono-adapter-mqtt-vertx I1027 16:54:42.580934 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.580938 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.582476 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.582612 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/services/eclipse-hono-service-auth I1027 16:54:42.582624 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.582629 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.585056 47587 round_trippers.go:446] Response Status: 404 Not Found in 2 milliseconds I1027 16:54:42.585718 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/services/eclipse-hono-service-device-registry-ext I1027 16:54:42.585744 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.585751 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.588982 47587 round_trippers.go:446] Response Status: 404 Not Found in 3 milliseconds I1027 16:54:42.589106 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/services/eclipse-hono-service-device-registry I1027 16:54:42.589113 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.589117 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.610037 47587 round_trippers.go:446] Response Status: 404 Not Found in 20 milliseconds I1027 16:54:42.610377 47587 round_trippers.go:420] GET https://192.168.1.148:6443/api/v1/namespaces/hono/services/eclipse-hono-service-device-registry-headless I1027 16:54:42.610486 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.610588 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.612235 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.612576 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/apps/v1/namespaces/hono/deployments/eclipse-hono-grafana I1027 16:54:42.612697 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.612809 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.615507 47587 round_trippers.go:446] Response Status: 404 Not Found in 2 milliseconds I1027 16:54:42.615843 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/apps/v1/namespaces/hono/deployments/eclipse-hono-prometheus-server I1027 16:54:42.616029 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.616139 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.618247 47587 round_trippers.go:446] Response Status: 404 Not Found in 2 milliseconds I1027 16:54:42.618409 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/apps/v1/namespaces/hono/deployments/eclipse-hono-artemis I1027 16:54:42.618447 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.618467 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.620109 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.620316 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/apps/v1/namespaces/hono/deployments/eclipse-hono-dispatch-router I1027 16:54:42.620339 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.620346 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.622906 47587 round_trippers.go:446] Response Status: 404 Not Found in 2 milliseconds I1027 16:54:42.623098 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/apps/v1/namespaces/hono/deployments/eclipse-hono-adapter-amqp-vertx I1027 16:54:42.623122 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.623130 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.624707 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.624895 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/apps/v1/namespaces/hono/deployments/eclipse-hono-adapter-http-vertx I1027 16:54:42.624973 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.625023 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.626353 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.626487 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/apps/v1/namespaces/hono/deployments/eclipse-hono-adapter-mqtt-vertx I1027 16:54:42.626505 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.626510 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.628267 47587 round_trippers.go:446] Response Status: 404 Not Found in 1 milliseconds I1027 16:54:42.628689 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/apps/v1/namespaces/hono/deployments/eclipse-hono-service-auth I1027 16:54:42.628819 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.628867 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.631044 47587 round_trippers.go:446] Response Status: 404 Not Found in 2 milliseconds I1027 16:54:42.631343 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/apps/v1/namespaces/hono/statefulsets/eclipse-hono-service-device-registry I1027 16:54:42.631363 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.631441 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.633605 47587 round_trippers.go:446] Response Status: 404 Not Found in 2 milliseconds I1027 16:54:42.674605 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/secrets I1027 16:54:42.674764 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.675001 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:42.675112 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.675172 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:42.706114 47587 round_trippers.go:446] Response Status: 201 Created in 30 milliseconds I1027 16:54:42.740360 47587 round_trippers.go:420] POST https://192.168.1.148:6443/apis/policy/v1beta1/podsecuritypolicies I1027 16:54:42.740513 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.740643 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.740711 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.741561 47587 round_trippers.go:420] POST https://192.168.1.148:6443/apis/policy/v1beta1/podsecuritypolicies I1027 16:54:42.741575 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.741579 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.741591 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.744624 47587 round_trippers.go:446] Response Status: 201 Created in 3 milliseconds I1027 16:54:42.746840 47587 round_trippers.go:446] Response Status: 201 Created in 5 milliseconds I1027 16:54:42.747308 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/serviceaccounts I1027 16:54:42.747374 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.747468 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.747548 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.747800 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/serviceaccounts I1027 16:54:42.747848 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.747857 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.747864 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.748019 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/serviceaccounts I1027 16:54:42.748048 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.748057 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.748064 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.751223 47587 round_trippers.go:446] Response Status: 201 Created in 3 milliseconds I1027 16:54:42.753235 47587 round_trippers.go:446] Response Status: 201 Created in 5 milliseconds I1027 16:54:42.765313 47587 round_trippers.go:446] Response Status: 201 Created in 17 milliseconds I1027 16:54:42.765550 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/secrets I1027 16:54:42.765563 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.765567 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.765570 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.765707 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/secrets I1027 16:54:42.765729 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.765742 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.765749 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.765836 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/secrets I1027 16:54:42.765877 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.765882 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.765888 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.765915 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/secrets I1027 16:54:42.765926 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.765936 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.765947 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.766024 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/secrets I1027 16:54:42.766035 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.766043 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.766049 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.766113 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/secrets I1027 16:54:42.766125 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.766129 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.766135 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.766198 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/secrets I1027 16:54:42.766209 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.766215 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.766222 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.766279 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/secrets I1027 16:54:42.766290 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.766294 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.766300 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.766342 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/secrets I1027 16:54:42.766352 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.766359 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.766365 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.787221 47587 round_trippers.go:446] Response Status: 201 Created in 21 milliseconds I1027 16:54:42.789809 47587 round_trippers.go:446] Response Status: 201 Created in 24 milliseconds I1027 16:54:42.791104 47587 round_trippers.go:446] Response Status: 201 Created in 24 milliseconds I1027 16:54:42.791611 47587 round_trippers.go:446] Response Status: 201 Created in 25 milliseconds I1027 16:54:42.791818 47587 round_trippers.go:446] Response Status: 201 Created in 25 milliseconds I1027 16:54:42.792031 47587 round_trippers.go:446] Response Status: 201 Created in 26 milliseconds I1027 16:54:42.792250 47587 round_trippers.go:446] Response Status: 201 Created in 26 milliseconds I1027 16:54:42.792466 47587 round_trippers.go:446] Response Status: 201 Created in 26 milliseconds I1027 16:54:42.793013 47587 round_trippers.go:446] Response Status: 201 Created in 26 milliseconds I1027 16:54:42.795264 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/configmaps I1027 16:54:42.795289 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.795294 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.795298 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.795444 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/configmaps I1027 16:54:42.795457 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.795461 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.795464 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.795570 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/configmaps I1027 16:54:42.795581 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.795584 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.796268 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.795834 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/configmaps I1027 16:54:42.796575 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.796725 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.795940 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/configmaps I1027 16:54:42.796167 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/configmaps I1027 16:54:42.797714 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.797760 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.798212 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.798248 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.797888 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.798436 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.798467 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.822737 47587 round_trippers.go:446] Response Status: 201 Created in 27 milliseconds I1027 16:54:42.827006 47587 round_trippers.go:446] Response Status: 201 Created in 30 milliseconds I1027 16:54:42.828821 47587 round_trippers.go:446] Response Status: 201 Created in 30 milliseconds I1027 16:54:42.829325 47587 round_trippers.go:446] Response Status: 201 Created in 33 milliseconds I1027 16:54:42.829783 47587 round_trippers.go:446] Response Status: 201 Created in 31 milliseconds I1027 16:54:42.830477 47587 round_trippers.go:446] Response Status: 201 Created in 31 milliseconds I1027 16:54:42.832531 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/persistentvolumeclaims I1027 16:54:42.832859 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.832964 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.833043 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.832630 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/persistentvolumeclaims I1027 16:54:42.833364 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.833474 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.833559 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.843261 47587 round_trippers.go:446] Response Status: 201 Created in 9 milliseconds I1027 16:54:42.850160 47587 round_trippers.go:446] Response Status: 201 Created in 17 milliseconds I1027 16:54:42.850624 47587 round_trippers.go:420] POST https://192.168.1.148:6443/apis/rbac.authorization.k8s.io/v1beta1/clusterroles I1027 16:54:42.850932 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.851249 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.851450 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.857746 47587 round_trippers.go:446] Response Status: 201 Created in 6 milliseconds I1027 16:54:42.858364 47587 round_trippers.go:420] POST https://192.168.1.148:6443/apis/rbac.authorization.k8s.io/v1beta1/clusterrolebindings I1027 16:54:42.858502 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.858700 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.858865 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.864503 47587 round_trippers.go:446] Response Status: 201 Created in 5 milliseconds I1027 16:54:42.864736 47587 round_trippers.go:420] POST https://192.168.1.148:6443/apis/rbac.authorization.k8s.io/v1/namespaces/hono/roles I1027 16:54:42.864762 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.864780 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.864788 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.864875 47587 round_trippers.go:420] POST https://192.168.1.148:6443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/hono/roles I1027 16:54:42.864887 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.864891 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.864894 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.868408 47587 round_trippers.go:446] Response Status: 201 Created in 3 milliseconds I1027 16:54:42.872007 47587 round_trippers.go:446] Response Status: 201 Created in 7 milliseconds I1027 16:54:42.872232 47587 round_trippers.go:420] POST https://192.168.1.148:6443/apis/rbac.authorization.k8s.io/v1/namespaces/hono/rolebindings I1027 16:54:42.872245 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.872329 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.872479 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.872763 47587 round_trippers.go:420] POST https://192.168.1.148:6443/apis/rbac.authorization.k8s.io/v1beta1/namespaces/hono/rolebindings I1027 16:54:42.872960 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.873081 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.873203 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.877091 47587 round_trippers.go:446] Response Status: 201 Created in 4 milliseconds I1027 16:54:42.879315 47587 round_trippers.go:446] Response Status: 201 Created in 6 milliseconds I1027 16:54:42.879613 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/services I1027 16:54:42.879743 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.879755 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.879761 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.879906 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/services I1027 16:54:42.879919 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.879924 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.879963 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.880163 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/services I1027 16:54:42.880295 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.880421 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.880547 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.880586 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/services I1027 16:54:42.880684 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.880753 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.880825 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.880843 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/services I1027 16:54:42.880972 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.881042 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.881165 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.881011 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/services I1027 16:54:42.881268 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.880762 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/services I1027 16:54:42.881531 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.881610 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.881684 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.879727 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/services I1027 16:54:42.881829 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.881954 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.881968 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.881457 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/services I1027 16:54:42.882178 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.882253 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.882325 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.881509 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/services I1027 16:54:42.882464 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.882473 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.882479 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.880676 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/services I1027 16:54:42.882494 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.882500 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.882506 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.880929 47587 round_trippers.go:420] POST https://192.168.1.148:6443/api/v1/namespaces/hono/services I1027 16:54:42.882518 47587 round_trippers.go:427] Request Headers: I1027 16:54:42.882547 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.882622 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.882714 47587 round_trippers.go:431] Accept: application/json I1027 16:54:42.882763 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:42.895226 47587 round_trippers.go:446] Response Status: 201 Created in 15 milliseconds I1027 16:54:42.928902 47587 round_trippers.go:446] Response Status: 201 Created in 48 milliseconds I1027 16:54:42.965381 47587 round_trippers.go:446] Response Status: 201 Created in 84 milliseconds I1027 16:54:42.987434 47587 round_trippers.go:446] Response Status: 201 Created in 106 milliseconds I1027 16:54:43.019106 47587 round_trippers.go:446] Response Status: 201 Created in 138 milliseconds I1027 16:54:43.034315 47587 round_trippers.go:446] Response Status: 201 Created in 152 milliseconds I1027 16:54:43.052382 47587 round_trippers.go:446] Response Status: 201 Created in 169 milliseconds I1027 16:54:43.053994 47587 round_trippers.go:446] Response Status: 201 Created in 172 milliseconds I1027 16:54:43.089905 47587 round_trippers.go:446] Response Status: 201 Created in 207 milliseconds I1027 16:54:43.146005 47587 round_trippers.go:446] Response Status: 201 Created in 263 milliseconds I1027 16:54:43.190758 47587 round_trippers.go:446] Response Status: 201 Created in 308 milliseconds I1027 16:54:43.204746 47587 round_trippers.go:446] Response Status: 201 Created in 322 milliseconds I1027 16:54:43.205148 47587 round_trippers.go:420] POST https://192.168.1.148:6443/apis/apps/v1/namespaces/hono/deployments I1027 16:54:43.205160 47587 round_trippers.go:427] Request Headers: I1027 16:54:43.205164 47587 round_trippers.go:431] Accept: application/json I1027 16:54:43.205167 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:43.205201 47587 round_trippers.go:420] POST https://192.168.1.148:6443/apis/apps/v1/namespaces/hono/deployments I1027 16:54:43.205209 47587 round_trippers.go:427] Request Headers: I1027 16:54:43.205388 47587 round_trippers.go:420] POST https://192.168.1.148:6443/apis/apps/v1/namespaces/hono/deployments I1027 16:54:43.205397 47587 round_trippers.go:427] Request Headers: I1027 16:54:43.205403 47587 round_trippers.go:431] Accept: application/json I1027 16:54:43.205408 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:43.205541 47587 round_trippers.go:420] POST https://192.168.1.148:6443/apis/apps/v1/namespaces/hono/deployments I1027 16:54:43.205549 47587 round_trippers.go:427] Request Headers: I1027 16:54:43.205553 47587 round_trippers.go:431] Accept: application/json I1027 16:54:43.205556 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:43.205697 47587 round_trippers.go:420] POST https://192.168.1.148:6443/apis/apps/v1/namespaces/hono/deployments I1027 16:54:43.205704 47587 round_trippers.go:427] Request Headers: I1027 16:54:43.205707 47587 round_trippers.go:431] Accept: application/json I1027 16:54:43.205710 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:43.205839 47587 round_trippers.go:420] POST https://192.168.1.148:6443/apis/apps/v1/namespaces/hono/deployments I1027 16:54:43.205845 47587 round_trippers.go:427] Request Headers: I1027 16:54:43.205849 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:43.205852 47587 round_trippers.go:431] Accept: application/json I1027 16:54:43.205984 47587 round_trippers.go:420] POST https://192.168.1.148:6443/apis/apps/v1/namespaces/hono/deployments I1027 16:54:43.205989 47587 round_trippers.go:427] Request Headers: I1027 16:54:43.205993 47587 round_trippers.go:431] Accept: application/json I1027 16:54:43.205997 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:43.206107 47587 round_trippers.go:420] POST https://192.168.1.148:6443/apis/apps/v1/namespaces/hono/deployments I1027 16:54:43.206112 47587 round_trippers.go:427] Request Headers: I1027 16:54:43.206116 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:43.206120 47587 round_trippers.go:431] Accept: application/json I1027 16:54:43.207392 47587 round_trippers.go:431] Accept: application/json I1027 16:54:43.207428 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:43.216117 47587 round_trippers.go:446] Response Status: 201 Created in 10 milliseconds I1027 16:54:43.223271 47587 round_trippers.go:446] Response Status: 201 Created in 15 milliseconds I1027 16:54:43.248163 47587 round_trippers.go:446] Response Status: 201 Created in 42 milliseconds I1027 16:54:43.248380 47587 round_trippers.go:446] Response Status: 201 Created in 42 milliseconds I1027 16:54:43.248544 47587 round_trippers.go:446] Response Status: 201 Created in 42 milliseconds I1027 16:54:43.248750 47587 round_trippers.go:446] Response Status: 201 Created in 42 milliseconds I1027 16:54:43.248965 47587 round_trippers.go:446] Response Status: 201 Created in 42 milliseconds I1027 16:54:43.249180 47587 round_trippers.go:446] Response Status: 201 Created in 43 milliseconds I1027 16:54:43.257313 47587 round_trippers.go:420] POST https://192.168.1.148:6443/apis/apps/v1/namespaces/hono/statefulsets I1027 16:54:43.257335 47587 round_trippers.go:427] Request Headers: I1027 16:54:43.257339 47587 round_trippers.go:431] Accept: application/json I1027 16:54:43.257352 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:43.359480 47587 round_trippers.go:446] Response Status: 201 Created in 102 milliseconds I1027 16:54:43.360482 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:43.361214 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:43.364171 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:43.365366 47587 round_trippers.go:420] DELETE https://192.168.1.148:6443/apis/batch/v1/namespaces/hono/jobs/eclipse-hono-post-install-device-registry-job I1027 16:54:43.365406 47587 round_trippers.go:427] Request Headers: I1027 16:54:43.365413 47587 round_trippers.go:431] Accept: application/json I1027 16:54:43.365420 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:43.452829 47587 round_trippers.go:446] Response Status: 200 OK in 87 milliseconds I1027 16:54:43.453476 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:43.453947 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:43.454748 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:43.456780 47587 loader.go:375] Config loaded from file: /home/bluestone/.kube/config I1027 16:54:43.520045 47587 round_trippers.go:420] PUT https://192.168.1.148:6443/api/v1/namespaces/hono/secrets/sh.helm.release.v1.eclipse-hono.v1 I1027 16:54:43.520068 47587 round_trippers.go:427] Request Headers: I1027 16:54:43.520073 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:43.520076 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:54:43.521802 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:54:43.567220 47587 round_trippers.go:446] Response Status: 200 OK in 45 milliseconds I1027 16:54:43.602616 47587 round_trippers.go:420] POST https://192.168.1.148:6443/apis/batch/v1/namespaces/hono/jobs I1027 16:54:43.602902 47587 round_trippers.go:427] Request Headers: I1027 16:54:43.602988 47587 round_trippers.go:431] Accept: application/json I1027 16:54:43.605347 47587 round_trippers.go:431] Content-Type: application/json I1027 16:54:43.638598 47587 round_trippers.go:446] Response Status: 201 Created in 33 milliseconds I1027 16:54:43.639029 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/batch/v1/namespaces/hono/jobs?fieldSelector=metadata.name%3Declipse-hono-post-install-device-registry-job I1027 16:54:43.639039 47587 round_trippers.go:427] Request Headers: I1027 16:54:43.639043 47587 round_trippers.go:431] Accept: application/json I1027 16:54:43.643285 47587 round_trippers.go:446] Response Status: 200 OK in 4 milliseconds I1027 16:54:43.650694 47587 retrywatcher.go:244] Starting RetryWatcher. I1027 16:54:43.650839 47587 round_trippers.go:420] GET https://192.168.1.148:6443/apis/batch/v1/namespaces/hono/jobs?fieldSelector=metadata.name%3Declipse-hono-post-install-device-registry-job&resourceVersion=15270&watch=true I1027 16:54:43.650858 47587 round_trippers.go:427] Request Headers: I1027 16:54:43.650877 47587 round_trippers.go:431] Accept: application/json I1027 16:54:43.652500 47587 round_trippers.go:446] Response Status: 200 OK in 1 milliseconds I1027 16:59:43.645684 47587 retrywatcher.go:146] Stopping RetryWatcher. I1027 16:59:43.646177 47587 retrywatcher.go:272] Stopping RetryWatcher. I1027 16:59:43.670148 47587 round_trippers.go:420] PUT https://192.168.1.148:6443/api/v1/namespaces/hono/secrets/sh.helm.release.v1.eclipse-hono.v1 I1027 16:59:43.670186 47587 round_trippers.go:427] Request Headers: I1027 16:59:43.670191 47587 round_trippers.go:431] Content-Type: application/json I1027 16:59:43.670195 47587 round_trippers.go:431] Accept: application/json, */* I1027 16:59:43.670198 47587 round_trippers.go:431] User-Agent: helm/v0.0.0 (linux/amd64) kubernetes/$Format I1027 16:59:43.694459 47587 round_trippers.go:446] Response Status: 200 OK in 24 milliseconds Error: failed post-install: timed out waiting for the condition

Afterwards the services look like this: ~$ kubectl get service -n hono NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE eclipse-hono-adapter-amqp-vertx LoadBalancer 10.109.126.70 <pending> 5672:32672/TCP,5671:32671/TCP 8m2s eclipse-hono-adapter-http-vertx LoadBalancer 10.104.182.136 <pending> 8080:30080/TCP,8443:30443/TCP 8m2s eclipse-hono-adapter-mqtt-vertx LoadBalancer 10.96.138.97 <pending> 1883:31883/TCP,8883:30883/TCP 8m2s eclipse-hono-artemis ClusterIP 10.106.93.37 <none> 5671/TCP 8m2s eclipse-hono-dispatch-router ClusterIP 10.109.132.65 <none> 5673/TCP 8m2s eclipse-hono-dispatch-router-ext LoadBalancer 10.111.61.254 <pending> 15671:30671/TCP,15672:30672/TCP 8m2s eclipse-hono-grafana ClusterIP 10.111.75.116 <none> 3000/TCP 8m3s eclipse-hono-prometheus-server ClusterIP 10.100.175.18 <none> 9090/TCP 8m3s eclipse-hono-service-auth ClusterIP 10.110.220.164 <none> 5671/TCP 8m3s eclipse-hono-service-device-registry ClusterIP 10.109.128.198 <none> 5671/TCP,8080/TCP,8443/TCP 8m2s eclipse-hono-service-device-registry-ext LoadBalancer 10.106.195.97 <pending> 28080:31080/TCP,28443:31443/TCP 8m2s eclipse-hono-service-device-registry-headless ClusterIP None <none> <none> 8m3s

What is the trick, to get this to install correctly?

sophokles73 commented 3 years ago

Hi @marcel-bluestone, I am sorry that it doesn't work for you. The logs you have provided do not seem to contain any line breaks which makes it quite impossible for me to recognize anything. Can you provide properly formatted logs and maybe in a first step reduce the verbosity of the helm command? We can then increase the level during further analysis.

marcel-bluestone commented 3 years ago

OK, here's what I did and the normal low verbosity log:


bluestone@kubernetes-master:~$ kubectl create namespace hono
namespace/hono created
bluestone@kubernetes-master:~$ helm install --dependency-update -n hono eclipse-hono eclipse-iot/hono
W1029 15:25:04.238066   13973 warnings.go:67] rbac.authorization.k8s.io/v1beta1 ClusterRole is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRole
W1029 15:25:04.239878   13973 warnings.go:67] rbac.authorization.k8s.io/v1beta1 ClusterRoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRoleBinding
W1029 15:25:04.242682   13973 warnings.go:67] rbac.authorization.k8s.io/v1beta1 Role is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 Role
W1029 15:25:04.246278   13973 warnings.go:67] rbac.authorization.k8s.io/v1beta1 RoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 RoleBinding
W1029 15:25:04.392119   13973 warnings.go:67] rbac.authorization.k8s.io/v1beta1 ClusterRole is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRole
W1029 15:25:04.395519   13973 warnings.go:67] rbac.authorization.k8s.io/v1beta1 ClusterRoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRoleBinding
W1029 15:25:04.399695   13973 warnings.go:67] rbac.authorization.k8s.io/v1beta1 Role is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 Role
W1029 15:25:04.404509   13973 warnings.go:67] rbac.authorization.k8s.io/v1beta1 RoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 RoleBinding
Error: failed post-install: timed out waiting for the condition```
sophokles73 commented 3 years ago

what version of kubernetes are you using?

marcel-bluestone commented 3 years ago

kubeadm version kubeadm version: &version.Info{Major:"1", Minor:"19", GitVersion:"v1.19.3", GitCommit:"1e11e4a2108024935ecfcb2912226cedeafd99df", GitTreeState:"clean", BuildDate:"2020-10-14T12:47:53Z", GoVersion:"go1.15.2", Compiler:"gc", Platform:"linux/amd64"}

sophokles73 commented 3 years ago

Does your cluster support LoadBalancers? If not, then you should use NodePorts for the services instead. You can enable them by setting the useLoadBalancer property to false when installing:

helm install --dependency-update -n hono --set useLoadBalancer=false eclipse-hono eclipse-iot/hono
marcel-bluestone commented 3 years ago

I tried it, but with the same result (see below). Actually I don't see why the cluster should not support LoadBalancers. I followed these instructions for setting it up 

helm install --dependency-update -n hono --set useLoadBalancer=false eclipse-hono eclipse-iot/hono
W1029 16:01:41.747990   25566 warnings.go:67] rbac.authorization.k8s.io/v1beta1 ClusterRole is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRole
W1029 16:01:41.749476   25566 warnings.go:67] rbac.authorization.k8s.io/v1beta1 ClusterRoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRoleBinding
W1029 16:01:41.750857   25566 warnings.go:67] rbac.authorization.k8s.io/v1beta1 Role is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 Role
W1029 16:01:41.753501   25566 warnings.go:67] rbac.authorization.k8s.io/v1beta1 RoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 RoleBinding
W1029 16:01:41.920378   25566 warnings.go:67] rbac.authorization.k8s.io/v1beta1 ClusterRole is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRole
W1029 16:01:41.926475   25566 warnings.go:67] rbac.authorization.k8s.io/v1beta1 ClusterRoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRoleBinding
W1029 16:01:41.931741   25566 warnings.go:67] rbac.authorization.k8s.io/v1beta1 Role is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 Role
W1029 16:01:41.938230   25566 warnings.go:67] rbac.authorization.k8s.io/v1beta1 RoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 RoleBinding
Error: failed post-install: timed out waiting for the condition
vasanth-bk commented 3 years ago

Hi @marcel-bluestone , can you post the result of kubectl get pods -n hono after this time out error.

marcel-bluestone commented 3 years ago

bluestone@kubernetes-master:~$ kubectl get pods -n hono NAME READY STATUS RESTARTS AGE eclipse-hono-adapter-amqp-vertx-765b97cdb8-7mbhz 0/1 Pending 0 44m eclipse-hono-adapter-http-vertx-f66d74b98-9ngxz 0/1 Pending 0 44m eclipse-hono-adapter-mqtt-vertx-64484dbcd5-zsb5z 0/1 Pending 0 44m eclipse-hono-artemis-76c6b9f9cb-6qgfp 0/1 Pending 0 44m eclipse-hono-dispatch-router-5d84d955f5-mq6qx 0/1 Pending 0 44m eclipse-hono-grafana-64778b89b5-h7m8z 0/2 Pending 0 44m eclipse-hono-post-install-device-registry-job-x2smg 0/1 Pending 0 44m eclipse-hono-prometheus-server-6dc58545bc-5fwwh 0/2 Pending 0 44m eclipse-hono-service-auth-c95647bcc-z6hm7 0/1 Pending 0 44m eclipse-hono-service-device-registry-0 0/1 Pending 0 44m

sophokles73 commented 3 years ago

@marcel-bluestone can you post the output of 

kubectl describe pod eclipse-hono-service-device-registry-0 -n hono
marcel-bluestone commented 3 years ago

$ kubectl describe pod eclipse-hono-service-device-registry-0 -n hono Name: eclipse-hono-service-device-registry-0 Namespace: hono Priority: 0 Node: Labels: app.kubernetes.io/component=service-device-registry app.kubernetes.io/instance=eclipse-hono app.kubernetes.io/managed-by=Helm app.kubernetes.io/name=hono app.kubernetes.io/version=1.4.0 controller-revision-hash=eclipse-hono-service-device-registry-59dc6f74b4 helm.sh/chart=hono-1.4.4 statefulset.kubernetes.io/pod-name=eclipse-hono-service-device-registry-0 Annotations: prometheus.io/path: /prometheus prometheus.io/port: 8088 prometheus.io/scrape: true Status: Pending IP:
IPs: Controlled By: StatefulSet/eclipse-hono-service-device-registry Containers: eclipse-hono-service-device-registry: Image: index.docker.io/eclipse/hono-service-device-registry-file:1.4.0 Ports: 8088/TCP, 8080/TCP, 8443/TCP, 5671/TCP, 5672/TCP Host Ports: 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP Limits: cpu: 1 memory: 300Mi Requests: cpu: 100m memory: 300Mi Liveness: http-get https://:health/liveness delay=180s timeout=1s period=10s #success=1 #failure=3 Readiness: http-get https://:health/readiness delay=10s timeout=1s period=10s #success=1 #failure=3 Environment: SPRING_CONFIG_LOCATION: file:///etc/hono/ SPRING_PROFILES_ACTIVE: dev LOGGING_CONFIG: classpath:logback-spring.xml JDK_JAVA_OPTIONS: -XX:MinRAMPercentage=80 -XX:MaxRAMPercentage=80 KUBERNETES_NAMESPACE: hono (v1:metadata.namespace) JAEGER_SERVICE_NAME: eclipse-hono-service-device-registry Mounts: /etc/hono from service-device-registry-conf (ro) /var/lib/hono/device-registry from registry (rw) /var/run/secrets/kubernetes.io/serviceaccount from default-token-lbb2h (ro) Conditions: Type Status PodScheduled False Volumes: service-device-registry-conf: Type: Secret (a volume populated by a Secret) SecretName: eclipse-hono-service-device-registry-conf Optional: false registry: Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace) ClaimName: eclipse-hono-service-device-registry ReadOnly: false default-token-lbb2h: Type: Secret (a volume populated by a Secret) SecretName: default-token-lbb2h Optional: false QoS Class: Burstable Node-Selectors: Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message

Warning FailedScheduling 4m11s (x47 over 70m) default-scheduler 0/2 nodes are available: 2 pod has unbound immediate PersistentVolumeClaims.

vasanth-bk commented 3 years ago

You have not created PersistentVolume (PV) for Prometheus pod and Device Registry pod. To know the PersistentVolumeClaim (PVC), please run the command kubectl get pvc -n hono and create the PVs accordingly in the same namespace. Once created, run kubectl get pv -n hono to know if the PVs and PVCs are bound successfully.

marcel-bluestone commented 3 years ago

kubectl get pvc -n hono NAME STATUS VOLUME CAPACITY ACCESS MODES STORAGECLASS AGE eclipse-hono-prometheus-server Pending 73m eclipse-hono-service-device-registry Pending 73m

@vasanth-bk : can you please illuminate me, how to create these PersistentVolumes? I did not find anything about it in the getting started guides...

vasanth-bk commented 3 years ago

To use local host storage for your PersistentVolume, create a yaml file with the below content:

apiVersion: v1
kind: PersistentVolume
metadata:
  name: pv-device-registry
spec:
  accessModes: 
   - ReadWriteOnce
  capacity:
    storage: 1Mi
  hostPath:
    path: /mnt/
    type: Directory

Then run kubectl create -f <name-of-the-yaml-file>. This is only suitable for development environment, for production you have to look at some cluster storage solution.

marcel-bluestone commented 3 years ago

thanks, I did as you said:

kubectl create -f pv_creation.yaml persistentvolume/pv-device-registry created

bluestone@kubernetes-master:~$ kubectl get pvc -n hono NAME STATUS VOLUME CAPACITY ACCESS MODES STORAGECLASS AGE eclipse-hono-prometheus-server Pending 90m eclipse-hono-service-device-registry Bound pv-device-registry 1Mi RWO 90m

vasanth-bk commented 3 years ago

can you now post the output of kubectl get pods -n hono ? While posting, could you also format these output as code snippets for easier readability?

marcel-bluestone commented 3 years ago

here is the result:

$ kubectl get pods -n hono 
NAME                                                  READY   STATUS    RESTARTS   AGE
eclipse-hono-adapter-amqp-vertx-765b97cdb8-7mbhz      0/1     Pending   0          99m
eclipse-hono-adapter-http-vertx-f66d74b98-9ngxz       0/1     Pending   0          99m
eclipse-hono-adapter-mqtt-vertx-64484dbcd5-zsb5z      0/1     Pending   0          99m
eclipse-hono-artemis-76c6b9f9cb-6qgfp                 0/1     Pending   0          99m
eclipse-hono-dispatch-router-5d84d955f5-mq6qx         0/1     Pending   0          99m
eclipse-hono-grafana-64778b89b5-h7m8z                 0/2     Pending   0          99m
eclipse-hono-post-install-device-registry-job-x2smg   0/1     Pending   0          99m
eclipse-hono-prometheus-server-6dc58545bc-5fwwh       0/2     Pending   0          99m
eclipse-hono-service-auth-c95647bcc-z6hm7             0/1     Pending   0          99m
eclipse-hono-service-device-registry-0                0/1     Pending   0          99m
vasanth-bk commented 3 years ago

Sorry, I think the PV has to be created in the same namespace, so the command should have been kubectl create -f <name-of-the-yaml-file> -n hono

Please try the following steps:

  1. Uninstall the existing hoho installation helm uninstall eclipse-hono

  2. Delete the PV you just created kubectl delete pv pv-device-registry

  3. Recreate the PV in hono namespace kubectl create -f <name-of-the-yaml-file> -n hono

  4. Install only hono, make grafana and prometheus installation false for the time being helm install --dependency-update -n hono --set useLoadBalancer=false --set prometheus.createInstance=false --set grafana.enabled=false eclipse-hono eclipse-iot/hono

I guess this time around, all the pods should be running successfully. Please post the output of kubectl get pods -n hono after the installation is complete.

marcel-bluestone commented 3 years ago

I followed your steps, with the adaption for 

1. helm uninstall -n hono eclipse-hono

The output of the helm install is unfortunately the same as before:

kubectl create -f pv_creation.yaml -n hono 
persistentvolume/pv-device-registry created
bluestone@kubernetes-master:~$ helm install --dependency-update -n hono --set useLoadBalancer=false --set prometheus.createInstance=false --set grafana.enabled=false eclipse-hono eclipse-iot/hono
Error: failed post-install: timed out waiting for the condition

Here's the output of the previous checks:

$ kubectl get pods -n hono
NAME                                                  READY   STATUS    RESTARTS   AGE
eclipse-hono-adapter-amqp-vertx-765b97cdb8-75n7r      0/1     Pending   0          10m
eclipse-hono-adapter-http-vertx-f66d74b98-dt5x8       0/1     Pending   0          10m
eclipse-hono-adapter-mqtt-vertx-64484dbcd5-vzprt      0/1     Pending   0          10m
eclipse-hono-artemis-76c6b9f9cb-qt8gw                 0/1     Pending   0          10m
eclipse-hono-dispatch-router-5d84d955f5-vc2bx         0/1     Pending   0          10m
eclipse-hono-post-install-device-registry-job-8dcf7   0/1     Pending   0          10m
eclipse-hono-service-auth-c95647bcc-nd88b             0/1     Pending   0          10m
eclipse-hono-service-device-registry-0                0/1     Pending   0          10m

and 

kubectl describe pod eclipse-hono-service-device-registry-0 -n hono
Name:           eclipse-hono-service-device-registry-0
Namespace:      hono
Priority:       0
Node:           <none>
Labels:         app.kubernetes.io/component=service-device-registry
                app.kubernetes.io/instance=eclipse-hono
                app.kubernetes.io/managed-by=Helm
                app.kubernetes.io/name=hono
                app.kubernetes.io/version=1.4.0
                controller-revision-hash=eclipse-hono-service-device-registry-59dc6f74b4
                helm.sh/chart=hono-1.4.4
                statefulset.kubernetes.io/pod-name=eclipse-hono-service-device-registry-0
Annotations:    prometheus.io/path: /prometheus
                prometheus.io/port: 8088
                prometheus.io/scrape: true
Status:         Pending
IP:             
IPs:            <none>
Controlled By:  StatefulSet/eclipse-hono-service-device-registry
Containers:
  eclipse-hono-service-device-registry:
    Image:       index.docker.io/eclipse/hono-service-device-registry-file:1.4.0
    Ports:       8088/TCP, 8080/TCP, 8443/TCP, 5671/TCP, 5672/TCP
    Host Ports:  0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP
    Limits:
      cpu:     1
      memory:  300Mi
    Requests:
      cpu:      100m
      memory:   300Mi
    Liveness:   http-get https://:health/liveness delay=180s timeout=1s period=10s #success=1 #failure=3
    Readiness:  http-get https://:health/readiness delay=10s timeout=1s period=10s #success=1 #failure=3
    Environment:
      SPRING_CONFIG_LOCATION:  file:///etc/hono/
      SPRING_PROFILES_ACTIVE:  dev
      LOGGING_CONFIG:          classpath:logback-spring.xml
      JDK_JAVA_OPTIONS:        -XX:MinRAMPercentage=80 -XX:MaxRAMPercentage=80
      KUBERNETES_NAMESPACE:    hono (v1:metadata.namespace)
      JAEGER_SERVICE_NAME:     eclipse-hono-service-device-registry
    Mounts:
      /etc/hono from service-device-registry-conf (ro)
      /var/lib/hono/device-registry from registry (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-lbb2h (ro)
Conditions:
  Type           Status
  PodScheduled   False 
Volumes:
  service-device-registry-conf:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  eclipse-hono-service-device-registry-conf
    Optional:    false
  registry:
    Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
    ClaimName:  eclipse-hono-service-device-registry
    ReadOnly:   false
  default-token-lbb2h:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  default-token-lbb2h
    Optional:    false
QoS Class:       Burstable
Node-Selectors:  <none>
Tolerations:     node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                 node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason            Age   From               Message
  ----     ------            ----  ----               -------
  Warning  FailedScheduling  11m   default-scheduler  0/2 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate, 1 node(s) had taint {node.kubernetes.io/disk-pressure: }, that the pod didn't tolerate.
  Warning  FailedScheduling  11m   default-scheduler  0/2 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate, 1 node(s) had taint {node.kubernetes.io/disk-pressure: }, that the pod didn't tolerate.
kubectl get pvc -n hono
NAME                                   STATUS   VOLUME               CAPACITY   ACCESS MODES   STORAGECLASS   AGE
eclipse-hono-service-device-registry   Bound    pv-device-registry   1Mi        RWO                           13m
kaniyan commented 3 years ago

You have not created PersistentVolume (PV) for Prometheus pod and Device Registry pod. To know the PersistentVolumeClaim (PVC), please run the command kubectl get pvc -n hono and create the PVs accordingly in the same namespace. Once created, run kubectl get pv -n hono to know if the PVs and PVCs are bound successfully.

EDIT: @marcel-bluestone @vasanth-bk The default Hono helm chart doesn't require Persistence Volumes Claims for both file and MongoDB based device registries. When you are also deploying a MongoDB database instance in the cluster, then it is optional to change the default configuration to enable MongoDB data persistence using PVC.

The default device registry being installed here is file-based device registry and it should have a PVC named eclipse-hono-service-device-registry automatically created. I see above from your output that PVC eclipse-hono-service-device-registry is already being created. If the MongoDB based device registry is being installed, then it doesn't require PVC as mentioned above.

@marcel-bluestone Could you try installing with the below command?

helm install --wait --timeout 10m --dependency-update -n hono --set useLoadBalancer=false eclipse-hono eclipse-iot/hono
vasanth-bk commented 3 years ago

@kaniyan The PVC named eclipse-hono-service-device-registry tells Kubernetes that there is a "claim" of some persistent volume required for the pod. Now, Kubernetes can either dynamically provision a PV, provided there is some sort of cluster wide storage solution or it can be manually created as a kubernetes resource by providing some storage from the host node. Once the PV is created, Kubernetes can bind this PV to the PVC for the pod to use.

Is this understanding right ?

@eliot4321 had advised me the same (to create PV) in the issue #146

ArashJavan commented 3 years ago

Got the same error!

my env: OS: Ubuntu 20.04.01 Minikube: 1.14.2 Kubectl-Client: 1.19.3 Kubectl-Client: 1.19.4 Helm: 3.4.0

I was able to install hono, only by disabling prometheus and grafana as follows:

helm install --dependency-update -n hono --set prometheus.createInstance=false --set grafana.enabled=false eclipse-hono eclipse-iot/hono

Otherwise I got following error:

pc@pc:~$ helm install --wait --timeout 10m  --dependency-update -n hono   eclipse-hono eclipse-iot/hono
W1112 10:14:54.087770   10174 warnings.go:67] rbac.authorization.k8s.io/v1beta1 ClusterRole is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRole
W1112 10:14:54.091744   10174 warnings.go:67] rbac.authorization.k8s.io/v1beta1 ClusterRoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRoleBinding
W1112 10:14:54.094274   10174 warnings.go:67] rbac.authorization.k8s.io/v1beta1 Role is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 Role
W1112 10:14:54.099809   10174 warnings.go:67] rbac.authorization.k8s.io/v1beta1 RoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 RoleBinding
W1112 10:14:54.674710   10174 warnings.go:67] rbac.authorization.k8s.io/v1beta1 ClusterRole is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRole
W1112 10:14:54.689367   10174 warnings.go:67] rbac.authorization.k8s.io/v1beta1 ClusterRole is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRole
W1112 10:14:54.692367   10174 warnings.go:67] rbac.authorization.k8s.io/v1beta1 ClusterRoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRoleBinding
W1112 10:14:54.700113   10174 warnings.go:67] rbac.authorization.k8s.io/v1beta1 ClusterRoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 ClusterRoleBinding
W1112 10:14:54.725376   10174 warnings.go:67] rbac.authorization.k8s.io/v1beta1 Role is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 Role
W1112 10:14:54.746155   10174 warnings.go:67] rbac.authorization.k8s.io/v1beta1 Role is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 Role
W1112 10:14:54.786016   10174 warnings.go:67] rbac.authorization.k8s.io/v1beta1 RoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 RoleBinding
W1112 10:14:54.793366   10174 warnings.go:67] rbac.authorization.k8s.io/v1beta1 RoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 RoleBinding
Error: persistentvolumeclaims "eclipse-hono-service-device-registry" not found
marcel-bluestone commented 3 years ago

I did not get it to run on the real kubernetes cluster. It seems the installation documentation lacks some steps for a fresh kubernetes cluster by now. I also sticked to the minikube version.

ArashJavan commented 3 years ago

@marcel-bluestone as I said before, the error is also there even using minikube, the only solution for now in my case is to deactivate prometheus and grafana installation.

vasanth-bk commented 3 years ago

@marcel-bluestone how many nodes did you originally have on your plain kubernetes cluster ?

See below the last two lines of the result of the command kubectl describe pod eclipse-hono-service-device-registry-0 -n hono, there is a warning regarding Kubernetes taint. Taints and Tolerations are an advanced concept in Kubernetes with respect to pod scheduling. Please check the link here and remove the taint on your nodes and try again.

Events:
  Type     Reason            Age   From               Message
  ----     ------            ----  ----               -------
  Warning  FailedScheduling  11m   default-scheduler  0/2 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate, 1 node(s) had taint {node.kubernetes.io/disk-pressure: }, that the pod didn't tolerate.
  Warning  FailedScheduling  11m   default-scheduler  0/2 nodes are available: 1 node(s) had taint {node-role.kubernetes.io/master: }, that the pod didn't tolerate, 1 node(s) had taint {node.kubernetes.io/disk-pressure: }, that the pod didn't tolerate.
sophokles73 commented 3 years ago

@marcel-bluestone is this still an issue or can this be closed?

marcel-bluestone commented 3 years ago

we gave up. This can be closed...