DalgoT4D / DDP_backend

Django app for the DDP platform
GNU Affero General Public License v3.0
11 stars 39 forks source link

SQL failures in dbt run should be reported as yellow #823

Open fatchat opened 3 weeks ago

fatchat commented 3 weeks ago

Similar to how we report dbt test failures as yellow

The new state will continue to show as RED in the pipeline overview, but the ops team should be able to filter them out of failure reports

fatchat commented 3 weeks ago

when a client's SQL fails, we show it to them as RED in their pipeline summary

but since the platform did not fail, prefect should show GREEN

but the pipeline will need to stop at that point, so prefect should treat it as a failure

and failure notifications should be triggered

fatchat commented 3 weeks ago

@himanshudube97 replicate two types of failures:

  1. dbt not found
  2. incorrect sql

see if prefect can distinguish the two