li-plus / chatglm.cpp

C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
MIT License
2.92k stars 333 forks source link

Error: CUDA error when release memory! #212

Open chestnut111 opened 10 months ago

chestnut111 commented 10 months ago

Error: CUDA error when release memory!

catmeowjiao commented 9 months ago

显存够吗

catmeowjiao commented 9 months ago

你可以参考这个试试 ztxz16/fastllm issues #363