search

smallcloudai / refact

WebUI for Fine-Tuning and Self-hosting of Open-Source Large Language Models for Coding
https://refact.ai
BSD 3-Clause "New" or "Revised" License
1.5k stars 100 forks source link

docker: Error response from daemon: could not select device driver "" with capabilities: [[gpu]]. #410

Closed koenig-arthur closed 2 months ago

koenig-arthur commented 2 months ago

Hi im new here. I started the docker as described: docker run -d --rm --gpus all --shm-size=256m -p 8008:8008 -v refact-perm-storage:/perm_storage smallcloud/refact_self_hosting:latest but im getting the error response from daemon: could not select device driver "" with capabilities: [[gpu]]. I don't think is missing driver because private AI and Ollama are running fine I can run it without --gpus all, but then it is useless

Im running ubuntu 22.04 lts

Gpu: nvidia t1000 8Gb (just for testing) Cpu: i9 13900 Ram: 64Gb

nvidia-smi: +---------------------------------------------------------------------------------------+ | NVIDIA-SMI 535.171.04 Driver Version: 535.171.04 CUDA Version: 12.2 | |-----------------------------------------+----------------------+----------------------+ | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |=========================================+======================+======================| | 0 NVIDIA T1000 8GB Off | 00000000:01:00.0 On | N/A | | 44% 60C P0 N/A / 50W | 1333MiB / 8192MiB | 2% Default | | | | N/A | +-----------------------------------------+----------------------+----------------------+

koenig-arthur commented 2 months ago

found the problem, nvidia-container-toolkit was not installed.