search

clue-ai / ChatYuan

ChatYuan: Large Language Model for Dialogue in Chinese and English
https://www.clueai.cn
Other
1.9k stars 183 forks source link

本模型如何应用DeepSparse, VLLM? #62

Open yitan800 opened 9 months ago

yitan800 commented 9 months ago

请问本模型支持DeepSparse, VLLM优化推理的速度吗？