增加openai接口部署吧

wenge-research / YAYI

雅意大模型：为客户打造安全可靠的专属大模型，基于大规模中英文多领域指令数据训练的 LlaMA 2 & BLOOM 系列模型，由中科闻歌算法团队研发。(Repo for YaYi Chinese LLMs based on LlaMA2 & BLOOM)

https://www.wenge.com/yayi/index.html

Apache License 2.0

3.25k stars 44 forks source link

Closed tianchiguaixia closed 5 months ago

tianchiguaixia commented 7 months ago

参考阿里的：python -m vllm.entrypoints.openai.api_server --model Qwen/Qwen1.5-7B-Chat

wenge-research commented 5 months ago

您好，vllm目前已适配完成，后续会适时更新。