Tune .bt at bor-mainnet Level0 storage.kv

erigontech / erigon

Ethereum implementation on the efficiency frontier https://erigon.gitbook.io

GNU Lesser General Public License v3.0

3.12k stars 1.1k forks source link

Tune .bt at bor-mainnet Level0 storage.kv #11303

Closed AskAlexSharov closed 2 months ago

AskAlexSharov commented 2 months ago

How big is .bt leaf at bor-mainnet Level0 storage.kv
How much places in file it touches
What if we increase/reduce M

awskii commented 2 months ago

increasing M 256-> 1024 lead to ramp of RAM from 106G to 129G on start on mainnet, so for bor effect will be even more dramatic.

bt leafs are not kept in memory, it's just key ordinal (di) and offset (offt) in file for that ordinal kept as elias-fano. Bt node is 16+len(key) bytes (so storage .bt requires more ram)