This project demonstrates how to use Apache Airflow to submit jobs to Apache spark cluster in different programming laguages using Python, Scala and Java as an example.
During docker-compose up --build airflow webserver exits and the process is tucked until it not killed and start again when airflow init done. Having restart: always will restart webserver building and building process will not be stopped
During docker-compose up --build airflow webserver exits and the process is tucked until it not killed and start again when airflow init done. Having
restart: always
will restart webserver building and building process will not be stopped