search

OpenMOSS / CoLLiE

Collaborative Training of Large Language Models in an Efficient Way
https://openlmlab-collie.readthedocs.io
Apache License 2.0
405 stars 58 forks source link

Add Mistral tp&pp model #174

Open LinqiY opened 4 months ago

KaiLv69 commented 4 months ago

看起来还处于草稿状态

  1. pycache不用上传到git
  2. modelpp.py和modeltp.py不需要保留，只需要保留一个model.py

如果可以review了可以comment叫我 :)

KaiLv69 commented 4 months ago

from collie.models.mistral import MistralConfig 没有这个文件