Dealing with diamonds old vs new demux

hydro-project / hydroflow

Hydro's low-level dataflow runtime

https://hydro.run/docs/hydroflow/

Apache License 2.0

468 stars 34 forks source link

Dealing with diamonds old vs new demux #913

Closed MingweiSamuel closed 3 weeks ago

MingweiSamuel commented 11 months ago

Old demux allowed us to combine a bunch of tees/merges into a single operator and eliminate subgraphs. New demux_enum doesn't allow that. Can we make this into an optimization or reason about demux to make this work?

MingweiSamuel commented 11 months ago

Closures in maps vs closures in demux
Can we (or why can't we) make something to combine demux/tee and unions to eliminate diamonds?
How should we think about filters with monotonicity