search

mikemccand / luceneutil

Various utility scripts for running Lucene performance tests
Apache License 2.0
205 stars 115 forks source link

handle vectors scaled for 8 bit storage #180

Closed msokolov closed 2 years ago

msokolov commented 2 years ago

I wanted to test LUCENE-10577: https://github.com/apache/lucene/pull/913 with luceneutil. This

  1. Adds a reference to a scaled vector document file that I uploaded to a shared space in my apache homedir
  2. Adds support for scaling vectors to WIkiVectors, VectorDictionary, and SearchPerfTest
  3. Defaults to using 8-bit vector storage when it is available

We probably shouldn't push this until we actually commit the Lucene changes it's intended to test. Although it wouldn't break anything. we might end up shipping something a bit different