search

puckel / docker-airflow

Docker Apache Airflow
Apache License 2.0
3.78k stars 544 forks source link

It's as if the scheduler is not running and DAGs are not getting triggered #617

Open cosbor11 opened 3 years ago

cosbor11 commented 3 years ago

Even when triggering dags from the console, there are no dag log files created. How do I start the scheduler? It looks like all that is started is the webserver. How can I execute dags and see the log runs for that?

leandrovieiraa commented 3 years ago

Hi, remember to enable your DAG on UI and after that you can trigger this dag with success, if you don't enable, you'll not see your dag running or any logs. To execute the scheduler and webserver you can check local docker-compose.yaml, a simple way is to use celery executor. All logs are stored on scheduler or worker, you can create some volumes to store the logs.