search

shibing624 / MedicalGPT

MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型，实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO。
Apache License 2.0
2.94k stars 451 forks source link

增量预训练效果评估 #349

Open qibao77 opened 3 months ago

qibao77 commented 3 months ago

Describe the Question

Please provide a clear and concise description of what the question is.

请教下，有对比测试过有无增量预训练的效果么？增量预训练的效果是怎么评估的呀？

shibing624 commented 3 months ago

few shot 评估，见各llm的benchmark，如ceval