huggingface / evaluate

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
https://huggingface.co/docs/evaluate
Apache License 2.0
1.98k stars 255 forks source link

Addition of SummEval Metric to `evaluate` Library #599

Open penguinwang96825 opened 3 months ago

penguinwang96825 commented 3 months ago

Description

This pull request introduces the integration of the SummEval metric into the HuggingFace's evaluate library. SummEval is a comprehensive evaluation framework for summarization models, which provides detailed assessments across multiple dimensions of text quality.

By integrating SummEval into the evaluate library, we extend the toolkit's capabilities in summarization evaluation, providing users with a robust tool for benchmarking model performance against a well-established standard.