search

gomate-community / rageval

Evaluation tools for Retrieval-augmented Generation (RAG) methods.
Apache License 2.0
81 stars 9 forks source link

Feature/add f1 ter chrf++ #76

Closed henan991201 closed 3 months ago

henan991201 commented 4 months ago

add f1, TER, chrf(contain chrf++) metrics

faneshion commented 3 months ago

@bugtig6351 can you review this PR?

codecov[bot] commented 3 months ago

Codecov Report

Attention: Patch coverage is 88.59060% with 17 lines in your changes are missing coverage. Please review.

Project coverage is 83.31%. Comparing base (85ce10a) to head (72c714f).

Files Patch % Lines
rageval/metrics/_answer_chrf.py 83.33% 7 Missing :warning:
rageval/metrics/_answer_ter.py 82.50% 7 Missing :warning:
rageval/metrics/_answer_f1.py 95.31% 3 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #76 +/- ## ========================================== + Coverage 82.41% 83.31% +0.90% ========================================== Files 26 29 +3 Lines 870 1019 +149 ========================================== + Hits 717 849 +132 - Misses 153 170 +17 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.