Runtime Error - "Distributed package doesn't have NCCL" when running runexp

AI-secure / InfoBERT

[ICLR 2021] "InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspective" by Boxin Wang, Shuohang Wang, Yu Cheng, Zhe Gan, Ruoxi Jia, Bo Li, Jingjing Liu

83 stars 7 forks source link

Runtime Error - "Distributed package doesn't have NCCL" when running runexp #3

Closed eaberman closed 3 years ago

eaberman commented 3 years ago

When I run source setup.sh && runexp anli-full infobert roberta-large 2e-5 32 128 -1 1000 42 1e-5 5e-3 6 0.1 0 4e-2 8e-2 0 3 5e-3 0.5 0.9 as specified in the README in the ANLI directory, I encounter a RuntimeError: Distributed package doesn't have NCCL built in message.

Do you have any advice on how to fix this?

Thank you! I really admire your work.

boxin-wbx commented 3 years ago

NCCL is usually installed together with PyTorch. You may try to reinstall PyTorch with conda.

eaberman commented 3 years ago

Thank you! I was able to fix this and get it running.