search

MLGroupJLU / LLM-eval-survey

The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".
https://arxiv.org/abs/2307.03109
1.38k stars 86 forks source link

Suggestion for adding OpenCompass to survey #11

Closed gaotongxiao closed 1 year ago

gaotongxiao commented 1 year ago

Hi team,

Thanks for your awesome survey! I was wondering if you might consider including the OpenCompass evaluation toolkit in your survey. At present, OpenCompass serves as a repository for over 50 benchmarks and enables systematic evaluation of LLMs. We are continually upgrading it to keep pace with the latest evaluation trends. I believe that its addition could provide an even richer context for your survey.

Best

MLGroupJLU commented 1 year ago

Thank you for your interest in our articles.

Coincidentally, we have also noticed your OpenCompass work before, we think it is a good and complete work, and we are also working on including it in our paper.

We will upload an updated version of the paper to arXiv, which may take a while, and look forward to your attention.

gaotongxiao commented 1 year ago

It's great to hear that. Thanks for your efforts again! 😀