search

Tele-AI / TeleChat-52B

38 stars 4 forks source link

vllm启动报错 #9

Open dongfangduoshou123 opened 3 weeks ago

dongfangduoshou123 commented 3 weeks ago

微信图片_20240820164058 按照介绍的，用vllm启动的时候会报错，起不来啊

luoyang1999 commented 2 weeks ago

You can try to add “architectures”:["TeleChatForCausalLM"] in config.json, and fix telechat.py L97 self.total_num_kv_heads=config.num_attention_heads