Various byte vector benchmark fixes - Githubissues

mikemccand / luceneutil

Various utility scripts for running Lucene performance tests

Apache License 2.0

202 stars 113 forks source link

Various byte vector benchmark fixes #282

Closed benwtrent closed 2 months ago

benwtrent commented 2 months ago

While benchmarking already quantized or byte vectors, I ran into various bugs.

This pr fixes them.

Corrects true nearest-neighbor calculation to use the byte comparator as our score transformations are different between bytes and floats
Adds a knn byte query (previous we always tried a float query, which would just break)
Fixed another weird vector reader bug which would always read just the first vector as calling bytes.get resets the bytes read.