castorini / rank_llm

RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.

http://rankllm.ai

Apache License 2.0

365 stars 43 forks source link

Add query and candidate #111

Closed sahel-sh closed 7 months ago

sahel-sh commented 7 months ago

This cl:

adds rerank_batch, query and candidate data classes.
removes doc inline demo
retriever only supports dataset or custom index,
pyserini_retriever creates requests
updates all demos to work with rerank_batch
rerank (non-batch) will be added in a follow up cl
tests will be updated in a follow up cl
if we decide to keep pyserini retriever, caching will be reenabled in a followup cl.

Pull Request Checklist

Reference Issue

Please provide the reference to issue this PR is addressing (# followed by the issue number). If there is no associated issue, write "N/A".

ref: #110

Checklist Items

Before submitting your pull request, please review these items:

[ ] Have you followed the contributing guidelines?
[x] Have you verified that there are no existing Pull Requests for the same update/change?
[ ] Have you updated any relevant documentation or added new tests where needed?

PR Type

What kind of change does this PR introduce?

[ ] Bugfix
[x] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Documentation content changes
[ ] Other...
- Description: