search

TimelyDataflow / timely-dataflow

A modular implementation of timely dataflow in Rust
MIT License
3.26k stars 272 forks source link

Exchange sort #435

Closed antiguru closed 3 months ago

antiguru commented 2 years ago

This is a draft to show how Timely could capture the exchange pattern, sort it, and reduce the cache misses for pushers.

Currently, this results in a significant performance regression for a low number of peers, but I'll try to test it on a machine with more workers.

antiguru commented 3 months ago

Not pursuing this at the moment.