search

carrotdata / carrot-cache

In-Out-Process Java cache (L1/L2 off-heap, scalable, ZeroGC) with full SSD support
Apache License 2.0
3 stars 0 forks source link

[CODE] `IndexFormat` to support configurable hash sizes #472

Open VladRodionov opened 3 weeks ago

VladRodionov commented 3 weeks ago

Currently, both MemoryIndex and IndexFormat supports only 8 - byte key hashes. We need support for larger hashes ( 16, 32 bytes at least) to reduce read range operations I/O in file - based caches. This will allow us to avoid 1 I/O operation to read a key from disk.

VladRodionov commented 3 weeks ago

We will compare long hashes in memory instead. Hash collisions are possible but their probability is extremely low even for 16 - byte hashes.