gsemet / kube-airflow

Helm chart to run production Airflow/Celery on Kubernetes
20 stars 8 forks source link

Workers always restarted within < 10 minutes and log file disappeared #12

Open ghifariram opened 6 years ago

ghifariram commented 6 years ago

I'm new in kubernetes. I deploy 4 workers and somehow they always restarted within < 10 minutes. When i check with kubectl get pods, the restart counter is not increased, and i can't access task's log file because the log files in that workers disappeared. Is that expected?

Log file isn't local. Fetching here: http://worker-3.workers.default.svc.cluster.local:8793/log/dagsname/task1/2018-02-19T00:00:00/1.log *** Failed to fetch log file from worker. 404 Client Error: NOT FOUND for http://worker-3.workers.default.svc.cluster.local:8793/log/dagsname/task1/2018-02-19T00:00:00/1.log