This repository contains the code for the paper: Set-Encoder: Permutation-Invariant Inter-Passage Attention for Listwise Passage Re-Ranking with Cross-Encoders.
We use lightning-ir to train and fine-tune models. Download and install the library to use the code in this repository.
We provide the following pre-trained models:
| Model Name | TREC DL 19 (BM25) | TREC DL 20 (BM25) | TREC DL 19 (ColBERTv2) | TREC DL 20 (ColBERTv2) |
|---|---|---|---|---|
| set-encoder-base | 0.724 | 0.710 | 0.788 | 0.777 |
| set-encoder-large | 0.727 | 0.735 | 0.789 | 0.790 |
We recommend using the lightning-ir cli to run inference. The following command can be used to run inference using the set-encoder-base model on the TREC DL 19 and TREC DL 20 datasets:
lightning-ir re_rank --config configs/re-rank.yaml --config configs/set-encoder-finetuned.yaml --config configs/trec-dl.yamlWIP