Add concurrent HNSW merge options to benchmarking & nightly benchmark

mikemccand / luceneutil

Various utility scripts for running Lucene performance tests

Apache License 2.0

205 stars 115 forks source link

Add concurrent HNSW merge options to benchmarking & nightly benchmark #242

Closed mikemccand closed 1 year ago

mikemccand commented 1 year ago

I added hnswThreadsPerMerge and hnswThreadPoolCount to Indexer and competition.Index/newIndex, and fixed nightly to pass these from its local constants.py file.

I have yet to disable strict top N checking for KNN hits when concurrency is enabled -- I'll do that as a followon commit after testing on nightly box!

Closes #239.