扩充词表后能否直接进行SFT呢？

shibing624 / MedicalGPT

MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型，实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO。

Apache License 2.0

2.94k stars 451 forks source link

Open HaotianLiu123 opened 3 months ago

HaotianLiu123 commented 3 months ago

Please provide a clear and concise description of what the question is.

请问扩充词表后能否直接进行SFT呢？如果可以的话，需要改变哪些参数么？