[Feature] add horovod and add the tests back

microsoft / nlp-recipes

Natural Language Processing Best Practices & Examples

MIT License

6.38k stars 916 forks source link

[Feature] add horovod and add the tests back #356

Open daden-ms opened 5 years ago

daden-ms commented 5 years ago

Description

Currently horovod installation is not included in the environment generation scripts and documentation of horovod is not complete. So we temporarily removed all the tests related to horovod. This issue is created to track this change. Once the story of horovod installation is ready, we should add the tests back.

saidbleik commented 5 years ago

We need to add these to the env. Ideally it should be optional:

install NCCL2
install Open MPI
install g++
pip install horovod