Add qwen2 tp&pp model - Githubissues

OpenMOSS / CoLLiE

Collaborative Training of Large Language Models in an Efficient Way

https://openlmlab-collie.readthedocs.io

Apache License 2.0

405 stars 58 forks source link

Closed Anti-Entrophic closed 5 months ago

Anti-Entrophic commented 5 months ago

Additional changes: Fixed an issue related to the version of deepspeed Add a loader for ".safetensors"

KaiLv69 commented 5 months ago

有model.py和model_tp.py，这两个文件有什么区别吗？最好还是合并到一个文件里 :)

Anti-Entrophic commented 5 months ago

有model.py和model_tp.py，这两个文件有什么区别吗？最好还是合并到一个文件里 :)

好的