google-research / t5x_retrieval

Apache License 2.0
94 stars 9 forks source link

Inference: document ranking functionality #5

Open littlewine opened 4 months ago

littlewine commented 4 months ago

Hi,

I am trying to use this repo to create a ranking for a set of queries on a document collection. That means that for each query, all documents should be ranked (ie. the similarities between query and document embeddings are computed, either using FAISS/ANN or exhaustively). Is this something that this repo supports? or is this repo purely intended for training models?

Also, what is the difference between infer_eval vs. eval? I see that the former requires to be run/called from the training script