TimelyDataflow / differential-dataflow

An implementation of differential dataflow using timely dataflow on Rust.
MIT License
2.53k stars 182 forks source link

Offset list counts zero offsets #454

Closed antiguru closed 7 months ago

antiguru commented 7 months ago

This change allows the OffsetList to count the length of a zero prefix of all offsets without actually storing the zero elements. This avoids consuming memory in a frequently-occurring pattern where at least the first element is zero, or if the singleton update optimization kicks in, a large prefix of elements (up to all) are zero.