search

QwenLM / qwen.cpp

C++ implementation of Qwen-LM
Other
538 stars 49 forks source link

什么时候出server功能 #26

Open AppleJunJiang opened 11 months ago

AppleJunJiang commented 11 months ago

类似llama.cpp的 ./server -m /models/ggml-model-q4_0.bin --host 0.0.0.0 --ctx-size2048 --n -gpu -layers 128