Marker-Inc-Korea / RAGchain

Extension of Langchain for RAG. Easy benchmarking, multiple retrievals, reranker, time-aware RAG, and so on...
Apache License 2.0
275 stars 28 forks source link

add ROUGE answer metric #397

Closed Eastsidegunn closed 8 months ago

Eastsidegunn commented 8 months ago

Now we have ROUGE score (answer evaluation with ground truths) change answer metric solution input for multiple ground truth values.

our function will calculate max of ROUGE scores between each gt values and answer

ROUGE - github ROUGE score - Wikipedia