add response analyzer into demos

castorini / rank_llm

RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.

http://rankllm.ai

Apache License 2.0

311 stars 39 forks source link

add response analyzer into demos #90

Closed sahel-sh closed 8 months ago

sahel-sh commented 8 months ago

This cl: 1- creates and end-2-end demo 2- fixes arg bug in trec_eval an enhances the demo by calculating different metrics 3- renames analyzer to remove verbose from the name 4- makes normalization optional in error count 5- adds analyzer to demos