Mattew from BOSHO about LEVELDB hickuips and performance

fbnzk / leveldb

Automatically exported from code.google.com/p/leveldb

BSD 3-Clause "New" or "Revised" License

0 stars 0 forks source link

Mattew from BOSHO about LEVELDB hickuips and performance #206

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago

Perhaps u already know:

https://www.youtube.com/watch?v=vo88IdglU_8

have fun!

Original issue reported on code.google.com by gstep...@gmail.com on 4 Oct 2013 at 4:18

GoogleCodeExporter commented 9 years ago

It's worth noting that most of Basho's changes are motivated by Riak using 
multiple LevelDB instances simultaneously. This leads to the multiple instances 
competing with each other during compaction. The video doesn't describe fixes 
that are generally applicable to most use cases.

Original comment by res...@gmail.com on 4 Oct 2013 at 4:45

GoogleCodeExporter commented 9 years ago

Yes. But the hickups also come from compaction layer, which simply stops the 
complete database at full buffers, single database only. He also mentioned, 
that he has done some patches (somewhere in the video there is  github url, 
where he reduced the read/write load from factor 11 (per data unit) to just 3. 
And he mentioned some checksum, that are built, but are never used, wasting CPU 
cycles. Worth watching, IMHO! Have fun!

Original comment by gstep...@gmail.com on 4 Oct 2013 at 4:54