Currently, when creating a reflection, dbt-dremio triggers it on dremio and instantly finishes the job if the trigger was successful. We would like to be able to configure a strategy that makes dbt wait for the completion of the reflection job on dremio, before marking it as successful and moving on to the next item in the dbt DAG. This would also allow us to get feedback on a reflection failure.
The configuration keyword could be strategy with the possible values depend or trigger, the later being the current and default value.
Justification for this enhancement
This feature would allow for better control and debugging of reflection jobs.
Describe the enhancement requested
Currently, when creating a reflection, dbt-dremio triggers it on dremio and instantly finishes the job if the trigger was successful. We would like to be able to configure a strategy that makes dbt wait for the completion of the reflection job on dremio, before marking it as successful and moving on to the next item in the dbt DAG. This would also allow us to get feedback on a reflection failure.
The configuration keyword could be
strategy
with the possible valuesdepend
ortrigger
, the later being the current and default value.Justification for this enhancement
This feature would allow for better control and debugging of reflection jobs.