search

gomate-community / rageval

Evaluation tools for Retrieval-augmented Generation (RAG) methods.
Apache License 2.0
81 stars 9 forks source link

add generator metrics #94

Closed QianHaosheng closed 2 months ago

QianHaosheng commented 2 months ago

add LCSRatio metric and Accuracy metric

codecov[bot] commented 2 months ago

Codecov Report

Attention: Patch coverage is 95.23810% with 3 lines in your changes are missing coverage. Please review.

Project coverage is 81.71%. Comparing base (693c466) to head (8ec9afe).

:exclamation: Current head 8ec9afe differs from pull request most recent head eb9a672. Consider uploading reports for the commit eb9a672 to get more accurate results

Files Patch % Lines
rageval/metrics/_answer_lcs_ratio.py 94.28% 2 Missing :warning:
rageval/metrics/_answer_accuracy.py 95.65% 1 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #94 +/- ## ========================================== + Coverage 80.96% 81.71% +0.75% ========================================== Files 29 31 +2 Lines 1061 1121 +60 ========================================== + Hits 859 916 +57 - Misses 202 205 +3 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.