TimelyDataflow / timely-dataflow

A modular implementation of timely dataflow in Rust
MIT License
3.25k stars 272 forks source link

Consolidate activation requests as they occur #502

Open frankmcsherry opened 1 year ago

frankmcsherry commented 1 year ago

The beginnings of an alternate approach to operator activations that allows the scheduler to consolidate activation requests. This introduces a new method that would allow consolidation (vs the existing one that makes consolidation hard by requiring distinct activations). Still work to be done, but checkpointing this in for the moment.