RuntimeError: NCCL error in: /opt/conda/conda-bld/pytorch_1603729009598/work/torch/lib/c10d/ProcessGroupNCCL.cpp:784, invalid usage, NCCL version 2.7.8

SamsungLabs / fcaf3d

[ECCV2022] FCAF3D: Fully Convolutional Anchor-Free 3D Object Detection

MIT License

231 stars 37 forks source link

RuntimeError: NCCL error in: /opt/conda/conda-bld/pytorch_1603729009598/work/torch/lib/c10d/ProcessGroupNCCL.cpp:784, invalid usage, NCCL version 2.7.8 #29

Closed PengboLi1998 closed 2 years ago

PengboLi1998 commented 2 years ago

hello，when i use your s3dis pretrained model to test,it throws the following errors.Could you please help me ? RuntimeError: NCCL error in: /opt/conda/conda-bld/pytorch_1603729009598/work/torch/lib/c10d/ProcessGroupNCCL.cpp:784, invalid usage, NCCL version 2.7.8

filaPro commented 2 years ago

Looks like your pytorch + cuda installation is not good. Can you please try with our Dockerfile? Also please attach the output of python mmdet3d/utils/collect_env.py and full traceback of the error from python.