li-plus / chatglm.cpp

C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4
MIT License
2.84k stars 327 forks source link

这个框架是否可以用于高并发的生产环境? #253

Closed aofengdaxia closed 5 months ago

aofengdaxia commented 5 months ago

rt

QwertyJack commented 5 months ago

不能,参考llama.cpp