search

SkyworkAI / Skywork

Skywork series models are pre-trained on 3.2TB of high-quality multilingual (mainly Chinese and English) and code data. We have open-sourced the model, training data, evaluation data, evaluation methods, etc. 天工系列模型在3.2TB高质量多语言和代码数据上进行预训练。我们开源了模型参数，训练数据，评估数据，评估方法。
Other
1.21k stars 111 forks source link

关于该模型的部署，官方有推荐的框架吗？ #59

Closed liwenju0 closed 9 months ago

liwenju0 commented 9 months ago

如题

zhao1iang commented 9 months ago

常用的框架都可以，包括vLLM，TGI。因为我们只是改变了模型size的相关参数，模型结构和llama是一样的，您完全可以用LLaMA模型的推理方案来推理Skywork