meltano / files-airflow

MIT License
0 stars 5 forks source link

BashOperator should inject env var to signal caller #19

Open pandemicsyn opened 2 years ago

pandemicsyn commented 2 years ago

Per https://github.com/meltano/internal-general/issues/391 we need a way to determine whether the meltano run $tasks are originating from Airflow. To do so we can inject an env var and use a BashOperator call like:

BashOperator(
    task_id=task_id,
    bash_command=f"cd {PROJECT_ROOT}; {MELTANO_BIN} run {run_args}",
    dag=dag,
    env={"MELTANO_CALLER": "airflow"}
)