yahoojapan / NGT

Nearest Neighbor Search with Neighborhood Graph and Tree for High-dimensional Data
Apache License 2.0
1.26k stars 115 forks source link

Is there any benchmark result for NGT QG/QBG? #139

Closed xiaofan-luan closed 1 year ago

xiaofan-luan commented 1 year ago

Hi Team, Thanks for the great work on quantinized graph. I wonder is there benchmark result for quantized graph build? Since build speed is also very important on production use cases

masajiro commented 1 year ago

For QB build times, ANN Benchmarks is a useful reference. Each dataset page contains various evaluation results like this.

xiaofan-luan commented 1 year ago

Thanks for the reply. NGT seems not listed in GIST and some other dataset. Is there any advice on improving NGT index build speed? This is also very important for real world production

masajiro commented 1 year ago

In general, there is a trade-off between build time and performance. For NGT, its build time can be reduced by changing parameters, but performance is also reduced. On the other hand, since NGT supports multi-threading for building the index, multi-core can significantly reduce the build time.

xiaofan-luan commented 1 year ago

Thanks for the clarifiction. Great work, will do more benchmark on it