ml6team / fondant

Production-ready data processing made easy and shareable
https://fondant.ai/en/stable/
Apache License 2.0
328 stars 25 forks source link

Support for non-linear DAGs #557

Open RobbeSneyders opened 8 months ago

RobbeSneyders commented 8 months ago

We currently only support non-linear DAGs, which limits the expressiveness of Fondant pipelines.

To support non-linear DAGs, we would need at least the following functionality:

Especially the last one is complex.

PhilippeMoussalli commented 8 months ago

I feel like this feature is needed but would not really prioritize it at the moment unless it's currently blocking us/other users from implementing a given pipeline