jaegertracing / helm-charts

Helm Charts for Jaeger backend
Apache License 2.0
267 stars 343 forks source link

specifying serviceAccounts for jaeger makes the operator fail #223

Open larsrnielsen opened 3 years ago

larsrnielsen commented 3 years ago

I have tried in different ways to configure service accounts for query, agent and collector to set required annotations for using AWS ES as a backend. The operator fails with not being able to parse the serviceAccount configuration part. Below I have tried to copy paste the default values for agent from chart's values.yaml to my values.yaml file. It fails with the same error. Removing the serviceAccount part from agent works fine, except that I don't get serviceAccounts for agent, query and collector. How can I get serviceAccounts with annotations generated?

Lars

operator configuration:

apiVersion: jaegertracing.io/v1
kind: Jaeger
metadata:
  annotations:
  creationTimestamp: "2021-01-29T11:31:42Z"
  generation: 20
  labels:
    argocd.argoproj.io/instance: jaeger-operator
    jaegertracing.io/operated-by: monitoring.jaeger-operator

  name: jaeger-operator-jaeger
  namespace: monitoring

spec:
  agent:
    config: {}
    options: {}
    resources: {}
    serviceAccount:
      annotations: {}
      create: true
      name: jaeger-agent
  allInOne:
    config: {}
    options: {}
    resources: {}
  collector:
    config: {}
    enabled: true
    maxReplicas: 5
    minReplicas: 3
    options: {}
    resources: {}
  ingester:
    config: {}
    options: {}
    resources: {}
  ingress:
    annotations:
      alb.ingress.kubernetes.io/backend-protocol: HTTP
      alb.ingress.kubernetes.io/certificate-arn: arn:aws:acm:eu-central-1:123456789012:certificate/1f67e75a-339a-4g7c-8d30-48b72ff3ba83
      alb.ingress.kubernetes.io/group.name: monitoring
      alb.ingress.kubernetes.io/listen-ports: '[{"HTTPS":443}, {"HTTP":80}]'
      alb.ingress.kubernetes.io/scheme: internal
      alb.ingress.kubernetes.io/security-groups: something
      alb.ingress.kubernetes.io/target-type: ip
      kubernetes.io/ingress.class: alb
    enabled: true
    hosts:
    - jaeger.cms-dev.something.com
    openshift: {}
    options: {}
    resources: {}
    security: none
  provisionDataStore:
    cassandra: false
    elasticsearch: false
    kafka: false
  query:
    enabled: true
    options: {}
    resources: {}
  resources:
    limits:
      cpu: 500m
      memory: 2048Mi
    requests:
      cpu: 250m
      memory: 254Mi
  sampling:
    options: {}
  storage:
    cassandraCreateSchema: {}
    dependencies:
      enabled: true
      resources: {}
      schedule: 55 23 * * *
    elasticsearch:
      nodeCount: 3
      redundancyPolicy: SingleRedundancy
      resources:
        limits:
          memory: 16Gi
        requests:
          cpu: "1"
          memory: 16Gi
      storage: {}
    esIndexCleaner:
      enabled: true
      numberOfDays: 7
      resources: {}
      schedule: 55 23 * * *
    esRollover:
      resources: {}
      schedule: 0 0 * * *
    options:
      es:
        index-prefix: cms-eks-jaeger-dev-7
        server-urls: https://something.com
    type: elasticsearch
  strategy: production
  ui:
    options: {}
status:
  phase: Running
  version: 1.21.0

operator log

time="2021-03-24T09:41:33Z" level=info msg=Versions arch=amd64 identity=monitoring.jaeger-operator jaeger=1.21.0 jaeger-operator=v1.21.2 operator-sdk=v0.18.2 os=linux version=go1.14.12
I0324 09:41:34.761866       1 request.go:621] Throttling request took 1.03693621s, request: GET:https://172.20.0.1:443/apis/apiextensions.k8s.io/v1?timeout=32s
time="2021-03-24T09:42:09Z" level=info msg="Consider running the operator in a cluster-wide scope for extra features"
I0324 09:42:10.403238       1 request.go:621] Throttling request took 1.046401062s, request: GET:https://172.20.0.1:443/apis/monitoring.coreos.com/v1?timeout=32s
time="2021-03-24T09:42:10Z" level=warning msg="failed to upgrade managed instances" error="v1.JaegerList.Items: []v1.Jaeger: v1.Jaeger.Spec: v1.JaegerSpec.Agent: v1.JaegerAgentSpec.JaegerCommonSpec: ServiceAccount: ReadString: expects \" or n, but found {, error found in #10 byte of ...|Account\":{\"annotatio|..., bigger context ...|:{},\"options\":{},\"resources\":{},\"serviceAccount\":{\"annotations\":{},\"create\":true,\"name\":\"jaeger-agen|..."
time="2021-03-24T09:42:10Z" level=info msg="Auto-detected the platform" platform=kubernetes
time="2021-03-24T09:42:10Z" level=info msg="Auto-detected ingress api" ingress-api=networking
time="2021-03-24T09:42:10Z" level=info msg="Automatically adjusted the 'es-provision' flag" es-provision=no
time="2021-03-24T09:42:10Z" level=info msg="Automatically adjusted the 'kafka-provision' flag" kafka-provision=no
time="2021-03-24T09:42:10Z" level=error msg="error getting a list of existing jaeger instances in namespace" error="v1.JaegerList.Items: []v1.Jaeger: v1.Jaeger.Spec: v1.JaegerSpec.Agent: v1.JaegerAgentSpec.JaegerCommonSpec: ServiceAccount: ReadString: expects \" or n, but found {, error found in #10 byte of ...|Account\":{\"annotatio|..., bigger context ...|:{},\"options\":{},\"resources\":{},\"serviceAccount\":{\"annotations\":{},\"create\":true,\"name\":\"jaeger-agen|..." namespace=monitoring
time="2021-03-24T09:42:15Z" level=warning msg="could not create ServiceMonitor object" error="servicemonitors.monitoring.coreos.com \"jaeger-operator-metrics\" already exists"
E0324 09:42:15.074617       1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.2/tools/cache/reflector.go:125: Failed to list *v1.Jaeger: v1.JaegerList.Items: []v1.Jaeger: v1.Jaeger.Spec: v1.JaegerSpec.Agent: v1.JaegerAgentSpec.JaegerCommonSpec: ServiceAccount: ReadString: expects " or n, but found {, error found in #10 byte of ...|Account":{"annotatio|..., bigger context ...|:{},"options":{},"resources":{},"serviceAccount":{"annotations":{},"create":true,"name":"jaeger-agen|...
time="2021-03-24T09:42:15Z" level=error msg="error getting a list of existing jaeger instances in namespace" error="v1.JaegerList.Items: []v1.Jaeger: v1.Jaeger.Spec: v1.JaegerSpec.Agent: v1.JaegerAgentSpec.JaegerCommonSpec: ServiceAccount: ReadString: expects \" or n, but found {, error found in #10 byte of ...|Account\":{\"annotatio|..., bigger context ...|:{},\"options\":{},\"resources\":{},\"serviceAccount\":{\"annotations\":{},\"create\":true,\"name\":\"jaeger-agen|..." namespace=monitoring
E0324 09:42:15.955296       1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.2/tools/cache/reflector.go:125: Failed to list *v1.Jaeger: v1.JaegerList.Items: []v1.Jaeger: v1.Jaeger.Spec: v1.JaegerSpec.Agent: v1.JaegerAgentSpec.JaegerCommonSpec: ServiceAccount: ReadString: expects " or n, but found {, error found in #10 byte of ...|Account":{"annotatio|..., bigger context ...|:{},"options":{},"resources":{},"serviceAccount":{"annotations":{},"create":true,"name":"jaeger-agen|...
E0324 09:42:18.382362       1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.2/tools/cache/reflector.go:125: Failed to list *v1.Jaeger: v1.JaegerList.Items: []v1.Jaeger: v1.Jaeger.Spec: v1.JaegerSpec.Agent: v1.JaegerAgentSpec.JaegerCommonSpec: ServiceAccount: ReadString: expects " or n, but found {, error found in #10 byte of ...|Account":{"annotatio|..., bigger context ...|:{},"options":{},"resources":{},"serviceAccount":{"annotations":{},"create":true,"name":"jaeger-agen|...
time="2021-03-24T09:42:20Z" level=error msg="error getting a list of existing jaeger instances in namespace" error="v1.JaegerList.Items: []v1.Jaeger: v1.Jaeger.Spec: v1.JaegerSpec.Agent: v1.JaegerAgentSpec.JaegerCommonSpec: ServiceAccount: ReadString: expects \" or n, but found {, error found in #10 byte of ...|Account\":{\"annotatio|..., bigger context ...|:{},\"options\":{},\"resources\":{},\"serviceAccount\":{\"annotations\":{},\"create\":true,\"name\":\"jaeger-agen|..." namespace=monitoring
E0324 09:42:24.188818       1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.2/tools/cache/reflector.go:125: Failed to list *v1.Jaeger: v1.JaegerList.Items: []v1.Jaeger: v1.Jaeger.Spec: v1.JaegerSpec.Agent: v1.JaegerAgentSpec.JaegerCommonSpec: ServiceAccount: ReadString: expects " or n, but found {, error found in #10 byte of ...|Account":{"annotatio|..., bigger context ...|:{},"options":{},"resources":{},"serviceAccount":{"annotations":{},"create":true,"name":"jaeger-agen|...
time="2021-03-24T09:42:25Z" level=error msg="error getting a list of existing jaeger instances in namespace" error="v1.JaegerList.Items: []v1.Jaeger: v1.Jaeger.Spec: v1.JaegerSpec.Agent: v1.JaegerAgentSpec.JaegerCommonSpec: ServiceAccount: ReadString: expects \" or n, but found {, error found in #10 byte of ...|Account\":{\"annotatio|..., bigger context ...|:{},\"options\":{},\"resources\":{},\"serviceAccount\":{\"annotations\":{},\"create\":true,\"name\":\"jaeger-agen|..." namespace=monitoring
time="2021-03-24T09:42:30Z" level=error msg="error getting a list of existing jaeger instances in namespace" error="v1.JaegerList.Items: []v1.Jaeger: v1.Jaeger.Spec: v1.JaegerSpec.Agent: v1.JaegerAgentSpec.JaegerCommonSpec: ServiceAccount: ReadString: expects \" or n, but found {, error found in #10 byte of ...|Account\":{\"annotatio|..., bigger context ...|:{},\"options\":{},\"resources\":{},\"serviceAccount\":{\"annotations\":{},\"create\":true,\"name\":\"jaeger-agen|..." namespace=monitoring
E0324 09:42:31.962635       1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.2/tools/cache/reflector.go:125: Failed to list *v1.Jaeger: v1.JaegerList.Items: []v1.Jaeger: v1.Jaeger.Spec: v1.JaegerSpec.Agent: v1.JaegerAgentSpec.JaegerCommonSpec: ServiceAccount: ReadString: expects " or n, but found {, error found in #10 byte of ...|Account":{"annotatio|..., bigger context ...|:{},"options":{},"resources":{},"serviceAccount":{"annotations":{},"create":true,"name":"jaeger-agen|...
TheAsteroid commented 2 years ago

I'm running into the same issue with jaeger-operator 2.25, trying to define automountServiceAccountToken.

│ E1005 09:37:31.873638 1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.20.7/tools/cache/reflector.go:167: Failed to watch *v1.Jaeger: failed to list *v1.Jaeger: v1.JaegerList.Items: []v1.Jaeger: v1.Jaeger.Spec: v1.JaegerSpec.Agent: v1.JaegerAgentSpec.JaegerCommonSpec: Se ││ rviceAccount: ReadString: expects " or n, but found {, error found in #10 byte of ...|Account":{"automount|..., bigger context ...|NonRoot":true,"runAsUser":1000},"serviceAccount":{"automountServiceAccountToken":false,"name":"jaege|... ││ time="2021-10-05T09:37:31Z" level=error msg="error getting a list of existing jaeger instances" error="v1.JaegerList.Items: []v1.Jaeger: v1.Jaeger.Spec: v1.JaegerSpec.Agent: v1.JaegerAgentSpec.JaegerCommonSpec: ServiceAccount: ReadString: expects \" or n, but found {, error f ││ ound in #10 byte of ...|Account\":{\"automount|..., bigger context ...|NonRoot\":true,\"runAsUser\":1000},\"serviceAccount\":{\"automountServiceAccountToken\":false,\"name\":\"jaege|..."