search

quickwit-oss / helm-charts

Helm charts for Quickwit
https://helm.quickwit.io
MIT License
22 stars 28 forks source link

Pod remaining in `ContainerCreating` state after an upgrade #12

Closed fmassot closed 1 year ago

fmassot commented 1 year ago

kubectl describe pod returns the following:

Name:             quickwit-indexing-demo-index-gh-archive-structured-b5mpv
Namespace:        indexing-demo
Priority:         0
Service Account:  default
Node:             ip-10-28-90-116.ec2.internal/10.28.90.116
Start Time:       Sat, 12 Nov 2022 12:07:49 +0100
Labels:           app.kubernetes.io/instance=quickwit-indexing-demo
                  app.kubernetes.io/managed-by=Helm
                  controller-uid=b9df73d9-4f2e-4025-8f29-f7030c751b0e
                  helm.sh/chart=quickwit-0.1.7
                  job-name=quickwit-indexing-demo-index-gh-archive-structured
Annotations:      kubernetes.io/psp: eks.privileged
Status:           Pending
IP:
IPs:              <none>
Controlled By:    Job/quickwit-indexing-demo-index-gh-archive-structured
Containers:
  quickwit:
    Container ID:
    Image:         quickwit/quickwit:edge
    Image ID:
    Port:          <none>
    Host Port:     <none>
    Command:
      /bin/bash
      -c
      quickwit index describe --index gh-archive-structured || quickwit index create --index-config gh-archive-structured.yaml
    State:          Waiting
      Reason:       ContainerCreating
    Ready:          False
    Restart Count:  0
    Environment:
      NAMESPACE:                        indexing-demo (v1:metadata.namespace)
      POD_NAME:                         quickwit-indexing-demo-index-gh-archive-structured-b5mpv (v1:metadata.name)
      POD_IP:                            (v1:status.podIP)
      QW_CONFIG:                        node.yaml
      QW_S3_ENDPOINT:                   https://s3.us-east-1.amazonaws.com
      AWS_REGION:                       us-east-1
      AWS_ACCESS_KEY_ID:                xxxx
      AWS_SECRET_ACCESS_KEY:            xxx
      QW_NODE_ID:                       $(POD_NAME)
      QW_PEER_SEEDS:                    quickwit-indexing-demo-headless
      QW_ADVERTISE_ADDRESS:             $(POD_IP)
      OTEL_EXPORTER_JAEGER_AGENT_HOST:  jaeger-agent.monitoring.svc.cluster.local
      OTEL_EXPORTER_JAEGER_AGENT_PORT:  6831
      QW_ENABLE_JAEGER_EXPORTER:        true
      POSTGRES_HOST:                    xxx
      POSTGRES_PORT:                    xxx
      POSTGRES_DATABASE:                indexing_demo_db
      POSTGRES_USERNAME:                indexing_demo
      POSTGRES_PASSWORD:                <set to the key 'postgres.password' in secret 'quickwit-indexing-demo'>  Optional: false
      QW_METASTORE_URI:                 postgres://$(POSTGRES_USERNAME):$(POSTGRES_PASSWORD)@$(POSTGRES_HOST):$(POSTGRES_PORT)/$(POSTGRES_DATABASE)
    Mounts:
      /quickwit/gh-archive-structured.yaml from index (rw,path="gh-archive-structured.yaml")
      /quickwit/node.yaml from config (rw,path="node.yaml")
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-g9cjn (ro)
Conditions:
  Type              Status
  Initialized       True
  Ready             False
  ContainersReady   False
  PodScheduled      True
Volumes:
  config:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      quickwit-indexing-demo
    Optional:  false
  index:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      quickwit-indexing-demo-bootstrap
    Optional:  false
  kube-api-access-g9cjn:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason       Age                      From     Message
  ----     ------       ----                     ----     -------
  Warning  FailedMount  21m (x99 over 6h40m)     kubelet  Unable to attach or mount volumes: unmounted volumes=[config index], unattached volumes=[config index kube-api-access-g9cjn]: timed out waiting for the condition
  Warning  FailedMount  5m54s (x205 over 6h46m)  kubelet  MountVolume.SetUp failed for volume "index" : configmap "quickwit-indexing-demo-bootstrap" not found
  Warning  FailedMount  62s (x41 over 6h44m)     kubelet  Unable to attach or mount volumes: unmounted volumes=[index config], unattached volumes=[index kube-api-access-g9cjn config]: timed out waiting for the condition
fmassot commented 1 year ago

Sounds like the job creating the pod was not correctly executed in a previous installation that was deleted. I will try to reproduce the initial problem and closing this issue for now.