iterative / dvc

🦉 Data Versioning and ML Experiments
https://dvc.org
Apache License 2.0
13.95k stars 1.19k forks source link

Output of `dvc dag` is unreadable if used with foreach/matrix stages #10614

Open ocraft opened 2 weeks ago

ocraft commented 2 weeks ago

If a pipeline contains a stage that is run multiple times with different parameters (foreach/matrix), each run is treated as a separate node in the output of the dvc dag command. With a large number of combinations, this result becomes completely unusable. It would make more sense to treat such a stage as a single node, perhaps with a special designation.