search

aviggiano / redis-roaring

Roaring Bitmaps for Redis
MIT License
348 stars 56 forks source link

High memory fragmentation because of libc malloc #52

Open swapnanil opened 6 years ago

swapnanil commented 6 years ago

I observed a high memory fragmentation (rss memory >> used memory or peak used memory) that I attribute to libc malloc. Can you please use jemalloc, as suggested by redis memory doctor?

aviggiano commented 6 years ago

Hi @swapnanil, thank you for checking this repository out. I'll include that in my TO-DO list, sure.

By the way, how are you using this module? Is it in production? What is your use case? I am curious about people's needs for compressed bitmaps in Redis.

swapnanil commented 6 years ago

Hi @aviggiano I came across your repository while looking for redis filtering data structures for a personal project. I wouldn't have seen the fragmentation if I had not run a jmeter load test. I can also do this task, i.e., use jemalloc in place of libc malloc and you can merge?

aviggiano commented 6 years ago

Hey,

Sure, that would be great. I'd be happy to accept a PR.

Thanks

swapnanil commented 6 years ago

Cool, will start working on it then. Thanks!