[BUG]: When using DB-GPT, with the continuous questioning, CUDA memory has been increasing until memory exploded

eosphoros-ai / DB-GPT

AI Native Data App Development framework with AWEL(Agentic Workflow Expression Language) and Agents

http://docs.dbgpt.cn

MIT License

13.74k stars 1.85k forks source link

[BUG]: When using DB-GPT, with the continuous questioning, CUDA memory has been increasing until memory exploded #147

Open Steffy-zxf opened 1 year ago

Steffy-zxf commented 1 year ago

Follow the tutorial to deploy DB-GPT on the ubuntu machine, 24g single-card GPU. As I continued to ask questions, CUDA memory kept increasing until memory exploded. How to free video memory?

csunny commented 1 year ago

During inference, the video memory itself will grow，We are also looking for a solution.

YangZeyu95 commented 1 year ago

Hi, any solution for this issue? I have the same issue and need to always restart llm server