Marker-Inc-Korea / RAGchain

Extension of Langchain for RAG. Easy benchmarking, multiple retrievals, reranker, time-aware RAG, and so on...
Apache License 2.0
279 stars 27 forks source link

add MSMARCO dataset evaluation code #299

Closed minsing-jin closed 11 months ago

minsing-jin commented 1 year ago

I will add comment how it evaluate retrieve. https://paperswithcode.com/dataset/ms-marco

minsing-jin commented 1 year ago

The MSMARCO dataset using industry standard evaluation metric is BLEU and ROUGE-L. https://github.com/microsoft/MSMARCO-Question-Answering#evaluation