Shrink containers if their capacity isn't needed

TimelyDataflow / differential-dataflow

An implementation of differential dataflow using timely dataflow on Rust.

MIT License

2.54k stars 183 forks source link

Shrink containers if their capacity isn't needed #405

Closed antiguru closed 8 months ago

antiguru commented 1 year ago

This eagerly releases memory after retracting large amount of data, without having to wait for another operation to happen.

antiguru commented 1 year ago

With https://github.com/TimelyDataflow/timely-dataflow/pull/530, we could shrink the Columnation-based variant, too.

antiguru commented 8 months ago

Not needed anymore with ord_neu. In addition, this only releases virtual memory, so it might need more memory than before because it needs to copy into a new allocation.