search

odigos-io / odigos

Distributed tracing without code changes. 🚀 Instantly monitor any application using OpenTelemetry and eBPF
https://odigos.io
Apache License 2.0
3.19k stars 194 forks source link

GKE upgrade v1.25 to v1.28 broke odigos daemonsets #1321

Closed dirtyren closed 3 months ago

dirtyren commented 3 months ago

Describe the bug GKE update from v1.25 pra v1.28 broke odigos daemonsets

I am getting the following error: Warning FailedCreate 2m5s (x85 over 8h) daemonset-controller Error creating: insufficient quota to match these scopes: [{PriorityClass In [system-node-critical system-cluster-critical]}] Another problem is that, after update, due to the daemonsets not starting, the apps orchestrated by Odigos also did not start.

To Reproduce Update GKE from v1.25 to v1.28

edeNFed commented 3 months ago

Thanks for reporting @dirtyren I will fix it asap

edeNFed commented 3 months ago

@dirtyren I am working on a fix for GKE that should be released soon. As a workaround you can run the following commands before installing Odigos and it will work: kubectl create namespace odigos-system kubectl label namespace odigos-system odigos.io/system-object="true"

Apply the following YAML:

apiVersion: v1
kind: ResourceQuota
metadata:
  name: odigos-quota
  namespace: odigos-system
spec:
  hard:
    pods: "10k"
  scopeSelector:
    matchExpressions:
    - operator: In
      scopeName: PriorityClass
      values:
      - system-node-critical