search

QwenLM / qwen.cpp

C++ implementation of Qwen-LM
Other
506 stars 40 forks source link

Create openai_api.py #35

Open yuebo opened 8 months ago

yuebo commented 8 months ago

add openai_api for qwen_cpp, you can change the model path and run with below command

uvicorn openai_api:app --host 0.0.0.0