你好，可复现论文评测结果的代码会开源吗？

FreedomIntelligence / HuatuoGPT-II

HuatuoGPT2, One-stage Training for Medical Adaption of LLMs. (An Open Medical GPT)

370 stars 60 forks source link

Open xielinzhen opened 5 months ago

xielinzhen commented 5 months ago

你好，使用HuatuoGPT2-7B在CMB/CMB-Exam/CMB-test/CMB-test-choice-question-merge.json上跑了一下，结果不理想，请问是否可以开源的一下可复现的代码

jymChen commented 3 months ago

@xielinzhen 您好，谢谢您的反馈，我们已经开源了QA的评测代码，可以运行下面命令进行复现：

accelerate launch evaluation/eval_qa.py --model_path=FreedomIntelligence/HuatuoGPT2-7B --data_path=./evaluation/data/eval_qa.json