LM Studio takes up more and more memory after running for a long time

lmstudio-ai / lmstudio-bug-tracker

Bug tracking for the LM Studio desktop application

10 stars 3 forks source link

LM Studio takes up more and more memory after running for a long time #172

Open realyw opened 3 weeks ago

realyw commented 3 weeks ago

clipboard_2024-10-25_15-26 I am running an embedded model, and after a long time or a large number of requests, the memory usage is very high.

yagil commented 3 weeks ago

Is this with 0.3.5?

realyw commented 3 weeks ago

这是 0.3.5 的吗？

Yes, it is not high at the beginning, but it gets higher as time goes by.

realyw commented 3 weeks ago

https://github.com/user-attachments/assets/b71e80f4-4668-4f8d-80b7-acea7352d0c1

Nanyisong commented 2 weeks ago

Same issue. I ran the 0.3.5 server mode (JIT loading) on a Mac Studio (M2) with the model ‘pixtral-12b’. The initial memory usage was 7.3 GB, but after two calls, the memory increased from 7.x GB to 27.49 GB.