microsoft / SPTAG

A distributed approximate nearest neighborhood search (ANN) library which provides a high quality vector index build, search and distributed online serving toolkits for large scale vector search scenario.
MIT License
4.82k stars 584 forks source link

Not enough memory on host devices offered by Azure #364

Open TylerRankin opened 1 year ago

TylerRankin commented 1 year ago

The resulting index for my application is over 32gb, so there are not many Azure services to host on. Azure needs to integrate this into a product database to store the vectors as well, so the front end device does not need 32gb of vectors loaded in to memory.