dagster-io / hooli-data-eng-pipelines

Example Dagster Cloud code for the Hooli Data Engineering organization.
72 stars 15 forks source link

Add a sensor for dbt views #101

Closed cnolanminich closed 1 month ago

cnolanminich commented 2 months ago

This PR adds a sensor that evaluates the hash value of the current state of the dbt code against the code version of the previous materialization. This is a way that you could leave dbt views unscheduled but update them anytime there is a change in the code.

I don't think this is absolutely core functionality for the demo project, but it has come up a few times and I wanted to show a solid solution in this space

github-actions[bot] commented 2 months ago

Your pull request at commit 45b04505712fbc0c8bb25c51a3643fa285ef8400 is automatically being deployed to Dagster Cloud.

Location Status Link Updated
demo_assets View in Cloud Jul 08, 2024 at 02:57 PM (UTC)
data-eng-pipeline View in Cloud Jul 08, 2024 at 02:57 PM (UTC)
basics View in Cloud Jul 08, 2024 at 02:57 PM (UTC)
batch_enrichment View in Cloud Jul 08, 2024 at 02:57 PM (UTC)
snowflake_insights View in Cloud Jul 08, 2024 at 02:57 PM (UTC)
izzye84 commented 1 month ago

LGTM. Thanks for cranking this out!