请问有没有训练过程相关的文档？

OpenMOSS / MOSS

An open-source tool-augmented conversational language model from Fudan University

https://txsun1997.github.io/blogs/moss.html

Apache License 2.0

11.89k stars 1.15k forks source link

Open sunway1988 opened 1 year ago

sunway1988 commented 1 year ago

想深入学习一下大模型从头开始的训练过程，看代码有些吃力，请问有没有训练过程相关的文档？

moseshu commented 1 year ago

就是个gpt的模型，还是用llama吧