search

dagster-io / hooli-data-eng-pipelines

Example Dagster Cloud code for the Hooli Data Engineering organization.
72 stars 15 forks source link

use new column level lineage method #97

Closed cnolanminich closed 2 months ago

cnolanminich commented 2 months ago

With the new method .fetch_column_metadata(), we don't have to rely on the dbt package approach, code is more clean!

Tested in this branch deployment and column level lineage propagating as we would expect.

github-actions[bot] commented 2 months ago

Your pull request at commit 317499651505cf5d6a9be7b3bfa96bb0f79ccc18 is automatically being deployed to Dagster Cloud.

Location Status Link Updated
basics View in Cloud Jun 12, 2024 at 04:37 PM (UTC)
demo_assets View in Cloud Jun 12, 2024 at 04:37 PM (UTC)
data-eng-pipeline View in Cloud Jun 12, 2024 at 04:37 PM (UTC)
snowflake_insights View in Cloud Jun 12, 2024 at 04:37 PM (UTC)
batch_enrichment View in Cloud Jun 12, 2024 at 04:37 PM (UTC)