mftcoder使用humaneval评估

codefuse-ai / MFTCoder

High Accuracy and efficiency multi-task fine-tuning framework for Code LLMs. This work has been accepted by KDD 2024.

Other

631 stars 67 forks source link

Open lwh8915 opened 5 months ago

lwh8915 commented 5 months ago

你好，想问下mftcoder怎么使用humaneval跑评分，我想先跑下codellama-7b-hf的humaneval评分，然后在它的基础上使用mftcoder微调之后再跑评分，但是不知道怎么写，新手求教程，谢谢