search

castorini / rank_llm

RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.
http://rankllm.ai
Apache License 2.0
312 stars 39 forks source link

p1- Update demo scripts #71

Closed sahel-sh closed 8 months ago

sahel-sh commented 8 months ago

1- Use ResultsWriter in the existing demos to write the output in three different formats (sorted hits in json format, output in trec eval format, and the ranking execution summary in json format) 2- rankGPT demo: Add a demo for creating a rankGPT agent, then create a reranker using the agent, call rerank, and write results, no need to populate parameters with default values, the demo should look as simple as possible.

yilinjz commented 8 months ago

@sahel-sh Can I take this as well? Seems similar to what I did in a previous PR.

sahel-sh commented 8 months ago

@yilinjz it is yours

sahel-sh commented 8 months ago

Thank you @yilinjz for working on this!