OpenMOSS / CoLLiE

Collaborative Training of Large Language Models in an Efficient Way
https://openlmlab-collie.readthedocs.io
Apache License 2.0
410 stars 58 forks source link

Add Qwen2 tp&pp model #161

Open Anti-Entrophic opened 6 months ago

KaiLv69 commented 6 months ago

测试test_generation.py pp_size=2和tp_size=2生成结果不一样。应该是kv cache的问题。