optimisations, memory and cpu

irfansharif / cfilter

Cuckoo Filter implementation in Go, better than Bloom Filters (unmaintained)

MIT License

762 stars 37 forks source link

Closed irfansharif closed 8 years ago

irfansharif commented 8 years ago

was pointed towards an issue raised here, two possible optimisations that could be made:

using array instead of slice for bucket and fingerprint, sizeof(slice) is 24 bytes. also every slice is a pointer indirection, given bucket and fingerprint sizes don't vary an array would fare better
additionally the original paper proposes usage of 12-bit fingerprints, 8-bit variants have lower memory efficiency for the same false positive probability.

irfansharif commented 8 years ago

ignoring using array instead of slice optimization for now because of configurable bucket/fingerprint size support
614a07111 introduces configurable fingerprint sizes, with the default size set to 12-bits