search

lmstudio-ai / lms

👾 LM Studio CLI
https://lms.dev
MIT License
1.69k stars 138 forks source link

CPU-only is not working #65

Closed dynamiccreator closed 21 hours ago

dynamiccreator commented 3 months ago

It is not possible to disable GPU acceleration, as then I get always an error:

"(Exit code: 0). Please check settings and try loading the model again. "

This is problematic as then it will consume VRAM which could have used for another process like TTS in case the model is fast enough on CPU only.

using ubuntu 22.04, gtx 1050

dynamiccreator commented 21 hours ago

Solution was to set to llama.cpp So no problem here at version 3.5. Fixed for me.