cohere-ai / DiskVectorIndex

Apache License 2.0
204 stars 11 forks source link

Creating my own Index #4

Open IneffableBunch opened 4 days ago

IneffableBunch commented 4 days ago

Hi! I see there are some precomputed indices, but no instructions or code to support creating your own. I can see on huggingface that the provided Wikipedia index is in the form of an .IDX file. Is there any documentation on how to create one? If the code used to create the wikipedia index could be shared that would be very helpful.

Thank you!

nreimers commented 2 days ago

It's mostly an IVF-PQ index in FAISS