search

jingyaogong / minimind

「大模型」3小时完全从0训练26M的小参数GPT，个人显卡即可推理训练！
https://jingyaogong.github.io/minimind
Apache License 2.0
2.7k stars 329 forks source link

此項目能繼續預訓練嗎? #62

Closed win10ogod closed 4 weeks ago

win10ogod commented 1 month ago

此項目能繼續預訓練嗎?

win10ogod commented 1 month ago

好了!我增加了一個能從檢查點繼續的預訓練腳本. @jingyaogong 我發pr

win10ogod commented 1 month ago

https://github.com/win10ogod/minimind

xrk2000 commented 1 month ago

3-full_sft.py 里也有吧