edgar971 / open-chat

A self-hosted, offline, ChatGPT-like chatbot with different LLM support. 100% private, with no data leaving your device.
MIT License
64 stars 8 forks source link

OpenChat-Cuda Nvidia Driver Version: | 520.56.06 #5

Open bigAboo80 opened 10 months ago

bigAboo80 commented 10 months ago

HI I/ve got this message

docker: Error response from daemon: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error running hook #0: error running hook: exit status 1, stdout: , stderr: Auto-detected mode as 'legacy' nvidia-container-cli: requirement error: unsatisfied condition: cuda>=12.2, please update your driver to a newer version, or use an earlier cuda container: unknown.

UNRAID 6.11.1 Nvidia Driver Version: | 520.56.06

What version if drivere I mast use?

edgar971 commented 10 months ago

I'm running the following:

Nvidia Driver Version: 535.54.03 UNRAID: 6.11.5

Are you passing the GPU under extras: --gpus all ? It should be by default unless it was removed.