cvallance / mongo-k8s-sidecar

Kubernetes sidecar for Mongo
MIT License
440 stars 298 forks source link

Connection timed out (worked well before) #110

Open CharlesB2 opened 4 years ago

CharlesB2 commented 4 years ago

For some reason after working without problems on GCP, our sidecar instance now fails with the following error:

> mongo-k8s-sidecar@0.1.0 start /opt/cvallance/mongo-k8s-sidecar                                                                                                  
> forever src/index.js                                                                                                                                            

warn:    --minUptime not set. Defaulting to: 1000ms                                                                                                               
warn:    --spinSleepTime not set. Your script will exit if it does not stay up for at least 1000ms                                                                
Using mongo port: 27017                                                                                                                                           
Starting up mongo-k8s-sidecar                                                                                                                                     
The cluster domain 'cluster.local' was successfully verified.                                                                                                     
Error in workloop { MongoError: connection 0 to 127.0.0.1:27017 timed out                                                                                         
    at Function.MongoError.create (/opt/cvallance/mongo-k8s-sidecar/node_modules/mongodb-core/lib/error.js:29:11)                                                 
    at Socket.<anonymous> (/opt/cvallance/mongo-k8s-sidecar/node_modules/mongodb-core/lib/connection/connection.js:200:20)                                        
    at Object.onceWrapper (events.js:273:13)                                                                                                                      
    at Socket.emit (events.js:182:13)                                                                                                                             
    at Socket._onTimeout (net.js:452:8)                                                                                                                           
    at listOnTimeout (timers.js:324:15)                                                                                                                           
    at processTimers (timers.js:268:5)                                                                                                                            
  name: 'MongoError',                                                                                                                                             
  message: 'connection 0 to 127.0.0.1:27017 timed out' }                                                                                                          

Complete log is here: sidecar.txt

Our statefulset.yml is the following:

apiVersion: apps/v1beta1
kind: StatefulSet
metadata:
  name: mongo
spec:
  serviceName: "mongo"
  replicas: 3
  template:
    metadata:
      labels:
        role: mongo
        environment: test
    spec:
      terminationGracePeriodSeconds: 10
      containers:
        - name: mongo
          image: mongo:3.4
          command:
            - mongod
            - "--replSet"
            - rs0
            - "--smallfiles"
            - "--noprealloc"
          ports:
            - containerPort: 27017
          volumeMounts:
            - name: mongo-persistent-storage
              mountPath: /data/db
        - name: mongo-sidecar
          image: cvallance/mongo-k8s-sidecar
          env:
            - name: MONGO_SIDECAR_POD_LABELS
              value: "role=mongo,environment=test"
ogostus commented 4 years ago

Same here I guess it's related to updating services into ssl ?!