seiflotfy / cuckoofilter

Cuckoo Filter: Practically Better Than Bloom
MIT License
1.11k stars 107 forks source link

During the encoding process, memory usage increased by 5 times #49

Open yanyouqi opened 4 months ago

yanyouqi commented 4 months ago

My filter has 100 million data, and it uses about 1GB of memory. During the encoding process, the memory increases to almost 7GB. What optimization can be done for encoding and decoding to reduce the intermediate memory consumption