prataprc
commented
6 years ago We are going with approach (b.)
While building the index, supply a non-zero vblocksize. For each z-index file, a corresponding value log will be created.
Closed prataprc closed 6 years ago
prataprc
commented
6 years ago We are going with approach (b.)
While building the index, supply a non-zero vblocksize. For each z-index file, a corresponding value log will be created.
Key, value pairs are stored in z-nodes, where each z-node maps to the natural block size of permanent storage. Z-blocks can range from 1KB to 4MB, and beyond 4MB it is difficult to store values. To solve this we can have 2 approaches.
a. Z-block sizes can be dynamic, in that the first 8 bytes of z-block will specify the size of the block and based on the size of values we can have z-block size to any length.
b. Save values in a separate file.