[BUG] <Error response from daemon: could not select device driver "nvidia" with capabilities: [[gpu]]>

Carey8175 commented 8 months ago

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

[X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

[X] 我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

指令：bash ./run.sh -c local -i 0 -b hf -m MiniChat-2-3B -t minichat error：Error response from daemon: could not select device driver "nvidia" with capabilities: [[gpu]]

期望行为 | Expected Behavior

+-----------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=============================================================================| | 0 N/A N/A 539 G /Xwayland N/A | +-----------------------------------------------------------------------------+

运行环境 | Environment

- OS:windows with wsl
- NVIDIA Driver:Driver Version: 546.17
- CUDA:CUDA Version: 12.3
- Docker Compose:
- NVIDIA GPU Memory:12G

QAnything日志 | QAnything logs

No response

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

No response

songkq commented 8 months ago

@Carey8175 Please upgrade your docker-compose(not docker compose) version >= 2.23.3.

AnHeYi commented 8 months ago

@songkq 我尝试升级docker-compose 目前版本为：v2.24.5 也有类似问题。

10ca1h0st commented 8 months ago

我也有同样的问题，目前的docker-compse也为v2.24.5

之后我尝试安装了NVIDIA Container Toolkit，现在可以了参考这篇文章https://blog.csdn.net/qq_35395195/article/details/131413664

woshituobaye commented 7 months ago

@Carey8175 Please upgrade your docker-compose(not docker compose) version >= 2.23.3.

大佬 UBUNtu 22 装了docker compose 没装docker-compose .也报这个错误。一定要安装这个吗？

woshituobaye commented 7 months ago

我也有同样的问题，目前的docker-compse也为v2.24.5

之后我尝试安装了NVIDIA Container Toolkit，现在可以了参考这篇文章https://blog.csdn.net/qq_35395195/article/details/131413664 大佬 UBUNtu 22 装了docker compose 没装docker-compose .也装了 NVIDIA Container Toolkit。也报这个错误。一定要安装docker-compose吗？

woshituobaye commented 7 months ago

我也有同样的问题，目前的docker-compse也为v2.24.5

之后我尝试安装了NVIDIA Container Toolkit，现在可以了参考这篇文章https://blog.csdn.net/qq_35395195/article/details/131413664

重启电脑就好了

1992leiting commented 7 months ago

For WSL2, follow the guidance to install Nvidia docker toolkit and the problem could be solved. https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html#configuring-docker

tandangwang commented 6 months ago

我也遇到此问题，仍然未解决。ubuntu22.04, Nvidia显卡驱动已更新，也尝试了install Nvidia docker toolkit。我的环境： Docker Compose version v2.26.1-desktop.1。启动方式 bash run.sh。网上能查到的方案都试过了，期待大佬提示。