microsoft / DiskANN

Graph-structured Indices for Scalable, Fast, Fresh and Filtered Approximate Nearest Neighbor Search
Other
1.06k stars 215 forks source link

[Question] DiskANN performance compared with mmap #493

Closed chasingegg closed 9 months ago

chasingegg commented 10 months ago

Vector search is more often as a read-only pattern, so as at this assumption, can we simply use mmap to reduce the memory usage and also a good performance?

harsha-simhadri commented 9 months ago

Yes, the disk index can be mmap'd and searched.