search

xant / libhl

Simple and fast C library implementing a thread-safe API to manage hash-tables, linked lists, lock-free ring buffers and queues
GNU Lesser General Public License v3.0
420 stars 117 forks source link

Tons of key-value pairs. #28

Closed lxyscls closed 3 years ago

lxyscls commented 4 years ago

Hello, I am looking for a hashtable which can hold millions or even more key-value pairs. Can this hashtable hold such payload, and give a good performance when there is some rebalance?

xant commented 4 years ago

I've been using it in a project where very large hashtables were being used. Also consider sharding if you want to scale horizontally.

sudashannon commented 3 years ago

Hello, I am looking for a hashtable which can hold millions or even more key-value pairs. Can this hashtable hold such payload, and give a good performance when there is some rebalance?

老哥用的咋样

lxyscls commented 3 years ago

Hello, I am looking for a hashtable which can hold millions or even more key-value pairs. Can this hashtable hold such payload, and give a good performance when there is some rebalance?

老哥用的咋样

我用khash + 读写锁，还行，就是内存比较吃，https://github.com/attractivechaos/klib