search

baichuan-inc / Baichuan-13B

A 13B large language model developed by Baichuan Intelligent Technology
https://huggingface.co/baichuan-inc/Baichuan-13B-Chat
Apache License 2.0
2.98k stars 236 forks source link

如何加速模型推理速度？ #205

Open hunfwj opened 7 months ago

hunfwj commented 7 months ago

如题， 有没有大佬知道Baichuan大模型用什么方式可以提高推理速度。