search

puckel / docker-airflow

Docker Apache Airflow
Apache License 2.0
3.75k stars 534 forks source link

Acessing dags inside docker container #384

Open aashray1495 opened 5 years ago

aashray1495 commented 5 years ago

I have been running airflow inside a docker container using

docker-compose run --rm webserver

Once airflow is up and running, I can see a couple of dags on the UI page but I cannot figure out where these dags are located

I have tried looking inside the container by using docker exec -it "container_id" /bin/bash

I would appreciate any help I could get in understanding this mechanism

Thank you

joaquinclearmetal commented 5 years ago

Inside the container: /usr/local/airflow/dags

aashray1495 commented 5 years ago

I checked as soon as I had created and the files weren't there but later I saw the dags in the folder.

There may have been some lag.

Thanks.

cduv commented 4 years ago

I'm having the same issue: Running docker-compose-LocalExecutor.yml

volumes:
  - ./dags:/usr/local/airflow/dags

Running:

docker pull puckel/docker-airflow
docker build --rm --file Dockerfile --build-arg AIRFLOW_DEPS="datadog,dask" --build-arg PYTHON_DEPS="flask_oauthlib>=0.9" -t puckel/docker-airflow .
docker-compose -f docker-compose-LocalExecutor.yml up -d --remove-orphans

Getting into the container: docker run --rm -ti puckel/docker-airflow bash

when doing ls, I can only see airflow.cfg file on '/usr/local/airflow/'

I waited for a minutes in case there is lag without any change.

I would appreciate any help I could get in understanding what I'm missing.

Thanks

cduv commented 4 years ago

Solved!!! Used as is commented in here. I found the other command on the README of the project. docker exec -it [container_id] /bin/bash

Thanks