GPU - Error trying to query CUDA gpus: No CUDA devices found!

[awesomecoderes]

OS: Ubuntu 24.04 Version: LM Studio 0.3.5 (build 2) Run command in linux terminal: nvidia-smi

Tue Nov 12 13:24:40 2024
+-----------------------------------------------------------------------------------------+ | NVIDIA-SMI 550.127.05 Driver Version: 550.127.05 CUDA Version: 12.4 | |-----------------------------------------+------------------------+----------------------+ | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |=========================================+========================+======================| | 0 NVIDIA GeForce RTX 4070 ... Off | 00000000:01:00.0 On | N/A | | 0% 44C P8 11W / 285W | 458MiB / 16376MiB | 6% Default | | | | N/A | +-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=========================================================================================| | 0 N/A N/A 3338 G /usr/lib/xorg/Xorg 236MiB | | 0 N/A N/A 3557 G /usr/bin/gnome-shell 103MiB | | 0 N/A N/A 318600 G ...erProcess --variations-seed-version 24MiB | | 0 N/A N/A 443495 G ...ures=SpareRendererForSitePerProcess 77MiB | +-----------------------------------------------------------------------------------------+

But lmstudio can not detect and use this device.

Problem:

gguf
runtime: CUDA llama.cpp (Linux) v1.2.0
{
  "result": {
    "code": "NoDevicesFound",
    "message": "Error trying to query CUDA gpus: No CUDA devices found!"
  },
  "gpuInfo": []
}