search

microsoft / DiskANN

Graph-structured Indices for Scalable, Fast, Fresh and Filtered Approximate Nearest Neighbor Search
Other
973 stars 202 forks source link

[Question] How do I test the FreshDiskANN system？Such as Insert, delete, streamingmerge and other operations #495

Open akdogiwjn opened 7 months ago

akdogiwjn commented 7 months ago

Hello,

I recently read about FreshDiskANN. I would like to know the code details for the following three steps, including (1) updating TempIndex and DeleteList in memory, (2) merging TempIndex and DeleteList into LTI on the SSD, and (3) performing search while updating the LTI.

But I can’t locate the code for these three steps. Does anyone know how to test it?

Thanks sincerely for any information.

rakri commented 5 months ago

Hi, we have a branch https://github.com/microsoft/DiskANN/tree/diskv2 which has the code https://github.com/microsoft/DiskANN/blob/diskv2/tests/test_concurr_merge_insert.cpp for testing the streaming code.

Note that this is quite out-dated, and we will upload a new version shorty (1-2 months hopefully).

lisirrx commented 5 months ago

hi @rakri, is there a WIP repo/branch of the new version freshdiskann code?