search

astronomer / cosmos-demo

Demo DAGs that show how to run dbt Core in Airflow using Cosmos
Apache License 2.0
25 stars 16 forks source link

Dependency is getting lost when the mode is getting referred through macros #3

Closed paritoshg2010 closed 8 months ago

paritoshg2010 commented 8 months ago

Hi Team,

I noticed that dependency graph is getting lost when the models are referred through macros. For example, in the below screenshot, the model B & C is created from macro where model B's macro is referring model A & model C's macro is referring model B in it. So ideally model A should run first & then B and then C. Here all three are running in parallel when using the DbtTaskGroup. Just to add, this dependency runs as expected when using simple dbt run command.

Through DbtTaskGroup:

image

Expected: Model A -> Model B -> Model C

Not sure if this is a known issue, but if you can please check and advise.

paritoshg2010 commented 8 months ago

Added it in the astronomer-cosmos https://github.com/astronomer/astronomer-cosmos/issues/714