Open jmazanec15 opened 6 months ago
Similar to the previous issue opened (#516) and since this is more tailored to vectorsearch
, please create this issue in the OSB workloads repository.
To enhance existing vector search queries, this can be done adding custom param sources workload.py
.
Closing this issue as the suggested changes does not relate to core OSB repository code.
Reopened as these would apply to already built-in OSB core operations that were added a while back.
Description
For some of our vector search cases, we use quantization to reduce the amount of memory that the index will consume during search. This comes with the tradeoff that recall will be worse because the quantization is lossy. One strategy to improve recall is to "rescore" the top results from the vector search with scores that originate from the full precision vectors. For example, the query would look like this:
I would like to add this option to the existing vector search queries in a configurable fashion.