gomate-community / rageval

Evaluation tools for Retrieval-augmented Generation (RAG) methods.
Apache License 2.0
81 stars 9 forks source link

fix some missing information for metric:_answer_nli_correctness #59

Closed faneshion closed 4 months ago

faneshion commented 4 months ago

@QianHaosheng update this metric by adding the missing informations. https://github.com/gomate-community/rageval/blob/1408f9bca73981993980b3f486198072bd3bedbe/rageval/metrics/_answer_nli_groudedness.py#L19

Note that all metrics should be implemented with detailed information. Below is an example from huggingface.datasets.metric: https://github.com/huggingface/datasets/blob/2.17.1/metrics/accuracy/accuracy.py