gomate-community / rageval

Evaluation tools for Retrieval-augmented Generation (RAG) methods.
Apache License 2.0
119 stars 9 forks source link

add alce eli5 benchmark #78

Closed QianHaosheng closed 6 months ago

QianHaosheng commented 6 months ago

In this PR, the ELI5 benchmark is implemented mainly based on ALCE repo.

In addition, during the test, it was found that the evaluation process was very slow and the user experience was not good. It will be necessary to support parallel computing for these metrics in later work.

faneshion commented 6 months ago

This PR is to address #62 issue~