illinoisdata / DeepOLA

7 stars 5 forks source link

Combine accumulator and scaler to avoid communication across execution nodes #141

Closed mIXs222 closed 1 year ago

mIXs222 commented 1 year ago

Previously, each scaler is a separate execution node subscribing to the previous aggregation accumulator and subscribed by the next node. This could lead to unnecessary cloning and communication across nodes, as well as overly complicated query implementations.