search

FastFilter / xor_singleheader

Header-only binary fuse and xor filter library
Apache License 2.0
348 stars 32 forks source link

Concurrent creation and merging? #35

Closed Bouncner closed 2 years ago

Bouncner commented 2 years ago

Do I understand your work correctly that it's not possible to combine multiple filters into one?

We are having a partitioned vector, which is prepared in multiple threads. We currently build BloomFilters and and them in the end. Is something similar possible with the xor of binary fuse filters?

lemire commented 2 years ago

You compute a filter over the union of the result using Bloom filters. I don’t see how that’s possible using xor or binary fuse filters.

Bouncner commented 2 years ago

Ok, thanks for the quick answer!