search

reverbrain / eblob

Eblob is an append-only low-level IO library, which saves data in blob files. Created as low-level backend for elliptics
GNU Lesser General Public License v3.0
104 stars 29 forks source link

Improve bloom hit rate and usability fixes. #30

Closed SaveTheRbtz closed 11 years ago

SaveTheRbtz commented 11 years ago

Applied guidelines from:

Less Hashing, Same Performance: Building a Better Bloom Filter, [Kirsch,Mitzenmacher 2006]

Some basic stats

> mean(old_bloom_misses)
[1] 13.25071
> mean(new_bloom_misses)
[1] 1.65624

Bloom misses fell drastically in expense of slightly increased CPU usage: old_bloom new_bloom

NB! Those are Log10 plots