Hi, I wonder if there's any interface we can use to construct IVF clusters with custom centroids vectors?
So instead of initialize the IVF index and add corpus vectors for train (which construct corpus centroids), can we manually designate some vectors as the centroids and update the clustering accordingly?
Seemingly this could be achieved by constructing a IndexFlat clusters on the custom centroids as quantizer, and manually construct nlist IndexFlat for each of these clusters after calculating the vector assignments using KNN.
But I wonder if there's a prebuild interface, which might be faster?
Hi, I wonder if there's any interface we can use to construct IVF clusters with custom centroids vectors?
So instead of initialize the IVF index and add corpus vectors for train (which construct corpus centroids), can we manually designate some vectors as the centroids and update the clustering accordingly?
Seemingly this could be achieved by constructing a IndexFlat clusters on the custom centroids as quantizer, and manually construct
nlist
IndexFlat for each of these clusters after calculating the vector assignments using KNN.But I wonder if there's a prebuild interface, which might be faster?
Thanks in advance!