search

dagster-io / hooli-data-eng-pipelines

Example Dagster Cloud code for the Hooli Data Engineering organization.
76 stars 15 forks source link

use stream definition for group #109

Open cnolanminich opened 3 months ago

cnolanminich commented 3 months ago

Small change, but useful to show how you could use the stream_definition to determine the asset group name (similar to how we do so with dbt metadata

format of stream_definition looks like:

      # stream_definition example 
      # {'name': 's3://hooli-demo/embedded-elt/locations.csv', 'config': {'object': 'locations'}}
github-actions[bot] commented 3 months ago

Your pull request at commit dff90f804e98b4c46f16ef8a320f04736368c2e7 is automatically being deployed to Dagster Cloud.

Location Status Link Updated
snowflake_insights View in Cloud Jul 29, 2024 at 04:25 PM (UTC)
demo_assets View in Cloud Jul 29, 2024 at 04:25 PM (UTC)
basics View in Cloud Jul 29, 2024 at 04:25 PM (UTC)
batch_enrichment View in Cloud Jul 29, 2024 at 04:25 PM (UTC)
data-eng-pipeline View in Cloud Jul 29, 2024 at 04:25 PM (UTC)