search

QwenLM / qwen.cpp

C++ implementation of Qwen-LM
Other
514 stars 42 forks source link

CPP Model API #19

Open halimabergaoui opened 9 months ago

halimabergaoui commented 9 months ago

Hello, Is there a way to use qwen API https://github.com/QwenLM/Qwen/blob/main/openai_api.py on the cpp model?

simonJJJ commented 9 months ago

I will add openai_api within this week.

AppleJunJiang commented 9 months ago

API功能预计啥时候可以推出，期待，不然只能本机cmd窗口玩玩无法实用

AppleJunJiang commented 8 months ago

官方更新api和server速度太慢了

YuRong-Lin commented 8 months ago

I will add openai_api within this week.

how about this week？

chuanzhubin commented 6 months ago

爱你不容易啊, qwen_1.8B, 一个API难

sweetcard commented 6 months ago

用llama.cpp吧。都有了。😄