attic-labs / noms

The versioned, forkable, syncable database
Apache License 2.0
7.45k stars 266 forks source link

Sync: Avoid exploding memory due to chunk hashes #3693

Open cmasone-attic opened 6 years ago

cmasone-attic commented 6 years ago

After #3659, we need to avoid exploding memory with just the size of the hashes of the next level. (Loading a leaf level of 1TB would require at least 5GB of hash bytes).