vectordotdev / helm-charts

Helm charts for Vector.
https://vector.dev
Mozilla Public License 2.0
114 stars 89 forks source link

DT cloudNativeFullStack unable to write on /var/lib #424

Closed aladdin-atypon closed 3 weeks ago

aladdin-atypon commented 3 weeks ago

Using DT with cloudNativeFullStack, see https://docs.dynatrace.com/docs/setup-and-configuration/setup-on-k8s/installation/cloud-native-fullstack

We are using helm to deploy it with the version 1.3.2, however, the init-container of dynatrace create some directories in a couple of volumes and mount them in the main container, the issue is coming from that fact that one of the mount points is inside /var/lib, which you define as a readonly since it's mounted from the host itself.

So can you please provide a guidelines of how to integrate vector and Dynatace cloudNativeFullStack?

The error is :

Warning Failed 16s (x3 over 32s) kubelet Error: failed to create containerd task: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error mounting "/var/lib/kubelet/pods/979c9380-d7c1-403f-b81f-f1a175e755cd/volumes/kubernetes.io~secret/metadata-enrichment-endpoint" to rootfs at "/var/lib/dynatrace/enrichment/endpoint": mkdir /run/containerd/io.containerd.runtime.v2.task/k8s.io/vector/rootfs/var/lib/dynatrace: read-only file system: unknown

the mount point DT tries to mount:

     - mountPath: /var/lib/dynatrace/oneagent/agent/config/container.conf
       name: oneagent-share
       subPath: container_vector.conf

The volume

   - emptyDir: {}
     name: oneagent-share