MathWebSearch / mws

MathWebSearch Implementation
https://search.mathweb.org/
GNU General Public License v3.0
47 stars 12 forks source link

Use relative pointers in compressed index #70

Closed cprodescu closed 10 years ago

cprodescu commented 10 years ago

Currently, there is a limit on 32Gb obtained by using 32bit offsets from the start of the memsector adn using the 8byte node alignment constraint. An alternative is to use relative pointers and have 2 types of internal nodes (a few with long pointers 64bit and most with 32bit relative pointers). This would remove the 32Gb limit.