stefan-grafberger / mlwhatif

Data-Centric What-If Analysis for Native Machine Learning Pipelines

Apache License 2.0

15 stars 3 forks source link

Closed stefan-grafberger closed 2 years ago

stefan-grafberger commented 2 years ago

Description

Pick the most simple example, e.g., the data corruption analysis, and implement it without any optimizations, just execute the generated planes directly with the DagExecutor

stefan-grafberger commented 2 years ago

Add a new artificial DAG node type that can be used to "extract" (named) pipeline intermediate results to outside the pipeline. Basically, something that can capture the results from operations like aggregate, that we want to store after a pipeline run in some DAG execution result map.