search

castorini / rank_llm

Repository for prompt-decoding using LLMs (GPT3.5, GPT4, Vicuna, and Zephyr)
http://rankllm.ai
Apache License 2.0
277 stars 36 forks source link

P3-2CR Pages #32

Open ronakice opened 6 months ago

ronakice commented 6 months ago

2cr pages for RankZephyr/Vicuna on MSv1/v2 to begin with like Pyserini - https://castorini.github.io/pyserini/2cr/msmarco-v1-passage.html

charlie-liuu commented 5 months ago

Working on this

ronakice commented 5 months ago

https://github.com/castorini/pyserini/tree/master/pyserini/2cr

This will be a good guide, we might want to add fields like Retrieval Method and top-$k$

ronakice commented 5 months ago

https://castorini.github.io/rank_llm/src/rank_llm/2cr/msmarco-v1-passage.html

We have the start of this.

This issue's goals now change to adding support for other datasets, MSv2 passage, NEWS, COVID, NovelEval in that order.