search

gomate-community / rageval

Evaluation tools for Retrieval-augmented Generation (RAG) methods.
Apache License 2.0
81 stars 9 forks source link

Add metrics implementation #106

Closed moshesbeta closed 1 week ago

moshesbeta commented 1 week ago

Add additional metrics on top of the existing ones, including perplexity, Mean Reciprocal Rank, NDCG, and other indicators.

moshesbeta commented 1 week ago

Each new metric requires a unit test.

And it is not appropriate to completely copy codes from other repositories. We can learn from others' excellent implementations, but we need to mark the sources.

In addition, I think it is necessary to keep the code style consistent in our repository. I'm sorry, I have received the above change requests and will modify the new metrics code to meet the requirements.