Fixing pgvector benchmark

castorini / pyserini

Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.

http://pyserini.io/

Apache License 2.0

1.57k stars 349 forks source link

Closed SeanSong25 closed 1 month ago

SeanSong25 commented 1 month ago

Replaced ivfflat to hnsw indices.
The <#> operator returns negative inner product, fixed the inner product query.
The cosine similarity should be used by subtracting it from 1 i.e. 1 - (vector <=> '[3,1,2]') as score.