TimelyDataflow / differential-dataflow

An implementation of differential dataflow using timely dataflow on Rust.
MIT License
2.58k stars 184 forks source link

Allow halfjoin to yield tastefully #342

Closed frankmcsherry closed 3 years ago

frankmcsherry commented 3 years ago

This PR modifies some internals for halfjoin to allow it to yield by user-supplied logic. That logic can look at the elapsed time and number of matched records, where ideally if it uses neither of them there is not much overhead (the time is provided as an Instant which means that the user decides to call elapsed or not).

cc @uce

frankmcsherry commented 3 years ago

Thanks very much for the review!