NET/Plugin : dlerror=libnccl-net.so: cannot open shared object file: No such file or directory No plugin found (libnccl-net.so)

modelscope / FunCodec

FunCodec is a research-oriented toolkit for audio quantization and downstream applications, such as text-to-speech synthesis, music generation et.al.

https://funcodec.github.io/

MIT License

371 stars 30 forks source link

NET/Plugin : dlerror=libnccl-net.so: cannot open shared object file: No such file or directory No plugin found (libnccl-net.so) #44

Open huyuelin opened 6 months ago

huyuelin commented 6 months ago

您好，当我在尝试多个gpu上训练时会遇到nccl库没有libnccl-net.so的报错，我已经确定我安装了版本为2.19.3的nccl库。而当我用单个gpu的训练时会遇到core dumped的问题。我目前用的是train-other-500 dev-other test-other这些数据集，请问是否对于这些报错有头绪