search

axiak / pybloomfiltermmap

Fast Python Bloom Filter using Mmap
http://axiak.github.com/pybloomfiltermmap/
MIT License
741 stars 137 forks source link

bloom filters with billions of items always returns true #80

Open assafmo opened 7 years ago

assafmo commented 7 years ago

I'm using this config - https://hur.st/bloomfilter?n=10000000000&p=0.0000001 (10 billion items), but then every check I make returns true.

The file size is around 40GB (which is good), but maybe there are some problems when items > c maxint (i.e. itmes>2.1 billion)?

Please help.

mizvyt commented 4 years ago

@assafmo, have you managed to resolve this?

I'm actively working on pybloomfiltermmap3, so I'd be happy to hear input on this, whether it's something to fix, or to put a notice about a limitation.

assafmo commented 4 years ago

Didn't manage to solve this, used bloomd instead. Sorry.