search

gomate-community / rageval

Evaluation tools for Retrieval-augmented Generation (RAG) methods.
Apache License 2.0
81 stars 9 forks source link

add simple metric for answergroundedness #32

Closed faneshion closed 5 months ago

faneshion commented 5 months ago

31

codecov[bot] commented 5 months ago

Codecov Report

Attention: 10 lines in your changes are missing coverage. Please review.

Comparison is base (3788503) 0.00% compared to head (1fac534) 58.24%. Report is 1 commits behind head on main.

Files Patch % Lines
rageval/utils/check_utils.py 69.56% 7 Missing :warning:
rageval/metrics/_answer_groudedness.py 95.23% 2 Missing :warning:
rageval/models/nli.py 83.33% 1 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #32 +/- ## ========================================= + Coverage 0 58.24% +58.24% ========================================= Files 0 15 +15 Lines 0 376 +376 ========================================= + Hits 0 219 +219 - Misses 0 157 +157 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

faneshion commented 5 months ago

30 add a simple nli model for answer groundedness.