search

castorini / rank_llm

Repository for prompt-decoding using LLMs (GPT3.5, GPT4, Vicuna, and Zephyr)
http://rankllm.ai
Apache License 2.0
273 stars 35 forks source link

Add eval to prebuilt dataset demo #88

Closed sahel-sh closed 5 months ago

sahel-sh commented 5 months ago

This cl: 1- adds eval to prebuilt dataset demo 2- applies minor corrections to EvalFunc class and its test

TESTED= the unittest passes, demo runs successfully and the run_trec_eval.py script also runs successfully.

sahel-sh commented 5 months ago

tracking issue: https://github.com/castorini/rank_llm/issues/89