villasv / aws-airflow-stack

Turbine: the bare metals that gets you Airflow
https://victor.villas/aws-airflow-stack/
MIT License
376 stars 69 forks source link

Code deploy features in CFT #120

Closed DevOpsAirflow closed 5 years ago

DevOpsAirflow commented 5 years ago

We are planing to deploy our DAGS using jenkins. In this case do we need code deploy? if we remove code deploy piece from CFT will it impact any airflow functionality?

villasv commented 5 years ago

Nope ;-) No problem, but you'll have to handle your deployments with new instances from AutoScaling. If you disable auto scaling, everything should be fine.

parthu50 commented 5 years ago

Thanks. Also, i guess not sure whether its related or not but we see /tmp/env.sh got deleted and some code references in /tmp. any idea why its happening ?

villasv commented 5 years ago

Did the instance restart? If so, it may explain the /tmp directory being wiped out. But the CFN initialization script will always recreate the env.sh file before running stuff that depends on it.