search

lmstudio-ai / configs

LM Studio JSON configuration file format and a collection of example config files.
MIT License
188 stars 32 forks source link

LM Studio GPU Offload Greyed Out #12

Open Tobe2d opened 8 months ago

Tobe2d commented 8 months ago

I am running the latest LM Studio from the website and I realized that GPU Offload is Greyed Out.

image

nvidia-smi showing the following:

Sun Jan 21 17:21:12 2024 +---------------------------------------------------------------------------------------+ | NVIDIA-SMI 546.33 Driver Version: 546.33 CUDA Version: 12.3 | |-----------------------------------------+----------------------+----------------------+ | GPU Name TCC/WDDM | Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |=========================================+===========+| | 0 NVIDIA GeForce RTX 4090 WDDM | 00000000:01:00.0 On | Off | | 0% 42C P8 29W / 450W | 2613MiB / 24564MiB | 10% Default | | | | N/A | +-----------------------------------------+----------------------+----------------------+

Am I missing anything here?