LivewareProblems / hyper

Erlang implementation of HyperLogLog
MIT License
16 stars 1 forks source link

explore hashing algorithm #4

Closed DianaOlympos closed 6 months ago

DianaOlympos commented 3 years ago

Rn we use sha hashing and we only use the first 64 bits.

Murmur or xxhash in a 64 bit version would probably have better entropy distribution. Is there a good maintained one for erlang? Should we import our own? Which one to pick?

DianaOlympos commented 2 years ago

Answer: they would need to be NIF for Rust or we would have to maintain them. This is not something i want to do for now, so meh.

I will leave it open if someone want to offer them

DianaOlympos commented 6 months ago

Will wait until OTP 28 or later, when the hash will be in erlang itself