search

castorini / ragnarok

Retrieval-Augmented Generation battle!
Apache License 2.0
36 stars 2 forks source link

RAG TREC #3

Closed eureka336 closed 1 month ago

eureka336 commented 2 months ago

When do you guys plan to release the race evaluation code for rag trec.

ronakice commented 1 month ago

We do not plan to release any evaluation code for the time being, we have built versions of it, but this is going to involve humans in the loop so nothing is public as of yet.

https://github.com/castorini/ragnarok/blob/main/docs/rag24.md describes a run down through how we would expect results, please take a look :)