This is another incremental computation paper, this time for updatable dataflow/streaming computations. The author blogs about achieving impressive performance while processing enormous amounts of data on a laptop that you'd normally use a cluster to process.
https://www.microsoft.com/en-us/research/wp-content/uploads/2013/01/differentialdataflow.pdf
This is another incremental computation paper, this time for updatable dataflow/streaming computations. The author blogs about achieving impressive performance while processing enormous amounts of data on a laptop that you'd normally use a cluster to process.
The project: https://github.com/frankmcsherry/differential-dataflow
It compiles to Timely Dataflow operators: https://github.com/frankmcsherry/timely-dataflow
Not sure if this background reading on Timely Dataflow is important: https://dl.acm.org/citation.cfm?id=2522738
The blog (on github itself): https://github.com/frankmcsherry/blog