TimelyDataflow / differential-dataflow

An implementation of differential dataflow using timely dataflow on Rust.
MIT License
2.53k stars 182 forks source link

Only retain two allocations #425

Closed antiguru closed 9 months ago

antiguru commented 9 months ago

This fixes retaining memory as large as the output when sealing the merge batcher for columnation.

frankmcsherry commented 9 months ago

This makes sense to me, after conversation with you!

antiguru commented 9 months ago

Confirming that it fixes the issue observed in https://github.com/MaterializeInc/materialize/issues/23389.