xverse-ai / XVERSE-13B

XVERSE-13B: A multilingual large language model developed by XVERSE Technology Inc.
Apache License 2.0
649 stars 58 forks source link

有加速方案吗? #7

Closed eigen2017 closed 1 year ago

eigen2017 commented 1 year ago

能配套一个加速方案吗,基于cuda+纯c的

underspirit commented 1 year ago

暂时没有计划提供cuda版本的推理方案