I'm experiencing an issue with my NVIDIA RTX 3050 (4GB VRAM) and 16GB RAM setup in LM Studio. Specifically, I've been running the LLaMA 3 8B model with GPU layers set to 20 and CPU threads set to 8, which is the configuration I've settled on after experimenting with different settings.
However, today I noticed that LM Studio is not utilizing my GPU as it normally does - previously, it would use around 50% of the GPU's capacity, but now it seems to be underutilizing it and cpu usage increased.
Could you please let me know if there's something I'm doing wrong or if I've missed a crucial setting? I'd appreciate your input on this matter.
yogeshs-vaf
commented
2 weeks ago
I'm experiencing an issue with my NVIDIA RTX 3050 (4GB VRAM) and 16GB RAM setup in LM Studio. Specifically, I've been running the LLaMA 3 8B model with GPU layers set to 20 and CPU threads set to 8, which is the configuration I've settled on after experimenting with different settings.
However, today I noticed that LM Studio is not utilizing my GPU as it normally does - previously, it would use around 50% of the GPU's capacity, but now it seems to be underutilizing it and cpu usage increased.
Could you please let me know if there's something I'm doing wrong or if I've missed a crucial setting? I'd appreciate your input on this matter.