search

dbt-checkpoint / dbt-checkpoint

:fishing_pole_and_fish: List of `pre-commit` hooks to ensure the quality of your `dbt` projects.
MIT License
584 stars 119 forks source link

dbt-build pre-hook #151

Open kokorin opened 1 year ago

kokorin commented 1 year ago

Describe the feature you'd like In our DBT project we use snapshot feature. On top of snapshots we build models (views) which contain monthly/weekly data. Snapshots can be build by using dbt snapshot and dbt build commands.

Now it's not possible to create snapshots with pre-hooks. So every user has to run dbt build command manually before first commit.

Additional context I think it makes sense to implement pre-hooks for both dbt snapshot and dbt build

noel commented 10 months ago

@kokorin This is not aligned with our plans for checkpoint. We believe that it should focus on the validation hooks vs adding all dbt commands since you can do this via another step in the GH Action. Is there a reason you would not be able to do that?

kokorin commented 10 months ago

Thank you for your reply. Originally we used dbt-checkpoint to validate changed/added models and all upstream models during pre-push hook. But recently our project grew up significantly and now we have 600+ DBT nodes. So we refused from running DBT at pre-push. Instead we validate whole project at CI.