dagster-io / dagster

An orchestration platform for the development, production, and observation of data assets.
https://dagster.io
Apache License 2.0
10.81k stars 1.35k forks source link

Allow exclude in op selection #6351

Open yuhan opened 2 years ago

yuhan commented 2 years ago

Use Case

I have multiple "input op()s" feeding into merge op() that then proceeds to a bunch of other ops()s. One of the input ops() is failing due to external data reasons. Currently the whole job is failing to execute. I'd like to execute everything excluding the failing input op().

Ideas of Implementation

~bad_op

Additional Info


Message from the maintainers:

Excited about this feature? Give it a :thumbsup:. We factor engagement into prioritization.

garethbrickman commented 1 month ago

Relates to https://github.com/dagster-io/dagster/issues/15761