search

attic-labs / noms

The versioned, forkable, syncable database
Apache License 2.0
7.45k stars 267 forks source link

Sync: Batch up chunk processing during pull #3751

Closed cmasone-attic closed 6 years ago

cmasone-attic commented 6 years ago

In Pull(), attempt to limit memory usage by capping the number of chunks processed at the same time. If a given level of the chunk graph has more than |batchSize| members, they will still be processed in order.

Fixes #3692

cmasone-attic commented 6 years ago

The first two patches are from #3738 PTAL at that, and then this