Missing ann-benchmarks documentation?

[loisaidasam]

The README says:

like Annoy, but with much higher recall

https://github.com/spotify/voyager/blob/c6d09ccc91d4689b15e99b6df965f4580af85358/README.md#L17

but I don't see any references to Voyager on the ann benchmarks page. Am I missing something?

[loretoparisi]

I think they were mentioning the fact that in respect to Annoy, Voyager is using hnsw lib as ANN, hence the base benchmark shows that Voyager has a higher Recall / Queries per seconds than Annoy. You can clearly see this from here.

[loisaidasam]

Which "base benchmark" are you referring to?

Perhaps faiss's hnsw implementation? or perhaps hnswlib? Those don't seem like fair comparisons, since Voyager is an entirely separate implementation.

Also, I think "clearly" is being generous. The way that the README links to ann-benchmarks suggests that one would see "Voyager" on these charts.

[loretoparisi]

hnswlib

I think a reasonable reference (Base line) could be the bare hnswlib. That said, according to the announcement, Voyager has a customized hnswllib version (as you can see from the sources), so the tests should be done from scratch to be more accurate.

[ijanderso]

Closing as it has been added to ann-benchmarks: https://github.com/erikbern/ann-benchmarks/pull/473