search

castorini / rank_llm

Repository for prompt-decoding using LLMs (GPT3.5, GPT4, Vicuna, and Zephyr)
http://rankllm.ai
Apache License 2.0
273 stars 35 forks source link

p1- response analysis and evaluation should work with the rerank results #77

Closed sahel-sh closed 5 months ago

sahel-sh commented 5 months ago

both response analysis and evaluation classes, take files as input. This means the user need to write the rerank results using resultsWriter after reranking, then call these modules with the newly created files. We should add the capability to the two classes to work with list[Result] as an alternative input format.

AndreSlavescu commented 5 months ago

interested

sahel-sh commented 5 months ago

PR https://github.com/castorini/rank_llm/pull/87 fixes the issue. @AndreSlavescu thank you for working on this!