Scheduler is not efficient in some cases, in which some operators are not supposed to be blocked by the region

Texera / texera

Collaborative Machine-Learning-Centric Data Analytics Using Workflows

https://texera.github.io

Apache License 2.0

160 stars 68 forks source link

Scheduler is not efficient in some cases, in which some operators are not supposed to be blocked by the region #2731

Open bobbai00 opened 1 month ago

bobbai00 commented 1 month ago

Take this workflow as the example, Sort and its downstream are supposed to keep running when the visualization branch is running. However, Sort and its downstream is actually waiting for the visualization to finish.