search

dagster-io / dagster

An orchestration platform for the development, production, and observation of data assets.
https://dagster.io
Apache License 2.0
11.26k stars 1.42k forks source link

Filtering asset graphs by group name #13818

Open bendnorman opened 1 year ago

bendnorman commented 1 year ago

What's the use case?

PUDL has a few pre-configured jobs and about a dozen asset groups. For example, we have a job that runs the ETL for all available years called etl_full and another job that runs the ETL for the most recent year of data called etl_fast:

image

When I click on an asset group and select "Materialize All", dagster uses the default configuration. It would be nice to be able to execute one asset group like clean_eia860 using the configuration of the etl_fast job.

Ideas of implementation

I think this could be achieved by being able to filter assets in Dagit using asset group name. Something like this:

image

Additional information

Originated from this discussion question #13792

Message from the maintainers

Impacted by this issue? Give it a 👍! We factor engagement into prioritization.

sryza commented 1 year ago

@braunjj thoughts on this? Did you have some relevant designs?

bengotow commented 10 months ago

Update: we've added group filtering to the global graph, but job graphs (pictured below) still don't offer this option

image