nlpxucan / WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
9.06k stars 709 forks source link

catastrophi forgetting #219

Open DaiJianghai opened 8 months ago

DaiJianghai commented 8 months ago

your work is excellent, i have used your code to fintune on my own dataset, but the phenomenon of catastrophi forgetting is serious. Could you give some suggestions to overcome it? Thanks a lot!