[storage] WAL style database index research & PoCs

ava-labs / hypersdk

Opinionated Framework for Building Hyper-Scalable Blockchains on Avalanche

https://hypersdk.xyz/

Other

191 stars 96 forks source link

[storage] WAL style database index research & PoCs #870

Open darioush opened 2 months ago

darioush commented 2 months ago

Currently, vilmo uses an in-memory hash map to map keys to their WAL location. This issue represents work to either:

reduce the amount of memory required per key (avoid storing the whole key in memory)
expand the index to use disk (avoid storing all keys in memory)

darioush commented 2 months ago

Should make a benchmarking utility to simulate the blockchain load (ie, rw/s that result from a zipf or uniform distribution of simple transfers)

github-actions[bot] commented 1 week ago

This issue has become stale because it has been open 60 days with no activity. Adding the lifecycle/frozen label will exempt this issue from future lifecycle events.