Oneflow-Inc / libai

LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
https://libai.readthedocs.io
Apache License 2.0
391 stars 55 forks source link

llm eval #535

Closed zsw256 closed 7 months ago

zsw256 commented 8 months ago

Adding codes for llm eval using lm_eval. Some codes in other projects are changed due to different versions of dependencies(transformers, especially).

xiezipeng-ML commented 7 months ago

调整一下格式: bash dev/linter.sh

xiezipeng-ML commented 7 months ago

evalharness.py,这个名字改改eval_harness之类的