search

astronomer / astro-cli

CLI that makes it easy to create, test and deploy Airflow DAGs to Astronomer
https://www.astronomer.io
Other
355 stars 70 forks source link

DAG-only like deploy functionality for dbt #1110

Open amw349 opened 1 year ago

amw349 commented 1 year ago

✍️ Is your feature request related to a problem? Please describe.

We currently have a monorepo approach for airflow + dbt. In order to deploy the dbt directory we need to perform an image rebuild and deploy when using astro deploy instead of a dag-only like deployment with the --dags (astro deploy --dags) flag.

🧩 Describe the solution you'd like

We'd like to request a feature where we can deploy files in the dbt directory (which is in the the same level as the dags folder) similar to how dags are deployed with the --dags flag so the workers and schedulers in our deployment pick up the changes without a restart.

🤔 Describe alternatives you've considered

One proposed solution was to nest the dbt directory inside the dags folder, but we'd rather have it at the same level.

Is your feature request specific to a particular Astronomer Platform?

fritz-astronomer commented 1 year ago

similar https://github.com/astronomer/astro-cli/issues/946

sunkickr commented 1 year ago

what is the reason that it can't be in the DAGs folder? I don't think we will be adding any more folders to dag-only deploy anytime soon