microsoft / SPTAG

A distributed approximate nearest neighborhood search (ANN) library which provides a high quality vector index build, search and distributed online serving toolkits for large scale vector search scenario.
MIT License
4.77k stars 581 forks source link

Building a 1000W BKT index crashes #410

Open suppersam1 opened 4 months ago

suppersam1 commented 4 months ago

Describe the bug I crashed when building a BKT index using 1000W, 10 dimension data, and the core file shows a crash in the following code. image I tried to move the part of the shuffling algorithm out of the concurrent part, and the core phenomenon disappeared. image

Desktop (please complete the following information):