microsoft / DiskANN

Graph-structured Indices for Scalable, Fast, Fresh and Filtered Approximate Nearest Neighbor Search
Other
1.02k stars 208 forks source link

[Question] Example for using DiskANN for VectorDB on Python #565

Open sleepingcat4 opened 1 month ago

sleepingcat4 commented 1 month ago

I wanted to know if I could be provided some examples to understand how we can create a vectorDB using embeddings and correspodning url. And index it using Python. We have memory constraints like we have 8-16GBish RAM and SSD.

We are currently using Intel Xeon Processors and some super computing clusters but when we are finished we want to index it for cosine similarity on fairly okaysih spec laptop. Any guidance/help?