self-diff cannot finish execution

Texera / texera

Collaborative Machine-Learning-Centric Data Analytics Using Workflows

https://texera.github.io

Apache License 2.0

163 stars 74 forks source link

self-diff cannot finish execution #2588

Open Yicong-Huang opened 7 months ago

Yicong-Huang commented 7 months ago

Similar to self-join, when running with one source and one diff, connecting the source operator to both ports of diff, will cause the execution never finish. CleanShot 2024-10-14 at 13 05 34@2x

Yicong-Huang commented 2 days ago

self intersection also does not work

Yicong-Huang commented 2 days ago

root cause: channel id does not differentiate port information. from CSV -> Diff there are two channels (each to one port), but the data are recognized to be passed from the same port. so the second port logic never executes