search

QwenLM / qwen.cpp

C++ implementation of Qwen-LM
Other
553 stars 48 forks source link

CPP Model API #19

Open halimabergaoui opened 1 year ago

halimabergaoui commented 1 year ago

Hello, Is there a way to use qwen API https://github.com/QwenLM/Qwen/blob/main/openai_api.py on the cpp model?

simonJJJ commented 1 year ago

I will add openai_api within this week.

AppleJunJiang commented 1 year ago

API功能预计啥时候可以推出，期待，不然只能本机cmd窗口玩玩无法实用

AppleJunJiang commented 1 year ago

官方更新api和server速度太慢了

YuRong-Lin commented 1 year ago

I will add openai_api within this week.

how about this week？

chuanzhubin commented 10 months ago

爱你不容易啊, qwen_1.8B, 一个API难

sweetcard commented 10 months ago

用llama.cpp吧。都有了。😄