search

getumbrel / llama-gpt

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
https://apps.umbrel.com/app/llama-gpt
MIT License
10.73k stars 696 forks source link

nvidia-container-cli error #132

Open bankersbaddream opened 10 months ago

bankersbaddream commented 10 months ago

I am not sure what is going on here

Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error running hook #0: error running hook: exit status 1, stdout: , stderr: Auto-detected mode as 'legacy' nvidia-container-cli: detection error: nvml error: unknown error: unknown

Black-Cat-CA commented 10 months ago

same issue here.

PopOS 22.04 RTX3080 cuda v11.5.119

I've made sure both cuda and nvidia-container-toolkit are installed. Also already tried the solution suggested here to no avail.

SushiWaUmai commented 8 months ago

Having the exact same problem on my linux machine.

tangarr commented 1 month ago

I had same error today. Package nvidia-container-tools in my distro was faulty (or maybe just outdated). Try to install it using official NVIDIA guide https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html Make sure to configure container runtime using nvidia-ctk after installation.