search

microsoft / CNTK

Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit
https://docs.microsoft.com/cognitive-toolkit/
Other
17.53k stars 4.28k forks source link

Cntk packages do not support OpenMPI 2+; Ubuntu no longer ships 1.* #3197

Closed Ark-kun closed 6 years ago

Ark-kun commented 6 years ago

The documentation tells me: https://docs.microsoft.com/en-us/cognitive-toolkit/setup-linux-python?tabs=cntkpy251

CNTK requires OpenMPI 1.10.x to be installed on your system. On Ubuntu 16.04 install it like this:

sudo apt-get install openmpi-bin

But the lowest version fopr Ubuntu 17.10 is 2.1.1-6. https://packages.ubuntu.com/artful/openmpi-bin

How can I install CNTK on a modern cloud Ubuntu version?

haixpham commented 6 years ago

You would have to download OpenMPI 1.x source code and build it, then set path to its .so. I did this all the time, since I don't have admin right on the training servers.

thiagocrepaldi commented 6 years ago

Look at line 46 on CNTK dockerfile for an example on how to compile openmpi 1.10: https://github.com/Microsoft/CNTK/blob/master/Tools/docker/CNTK-GPU-Image/Dockerfile

Ark-kun commented 6 years ago

The Dockerfile hack can work in some scenarios, but it's not quite suitable for online Jupyter-like environments (e.g. Google Colab).

I managed to work around this myself. The questions is how many thousands of potential CNTK users won't bother.

Ark-kun commented 6 years ago

/reopen

Ark-kun commented 6 years ago

Researches still do not have an easy way to install CNTK. Official documentation is still broken.

nikhil-sk commented 6 years ago

Are there plans to support CNTK with OpenMPI >=2? Or does the support already exist? The documentation here says 'at least' v1.10 : https://docs.microsoft.com/en-us/cognitive-toolkit/Setup-CNTK-on-Linux

However, I have not been able to setup cntk with versions >= 1.10. Has this already been fixed?

Ark-kun commented 6 years ago

@thiagocrepaldi Looks like this is still not fixed. Does CNTK officially only support legacy systems?

nikhil-sk commented 6 years ago

Has anyone got CNTK working with OpenMPI >=2 ?

TheButlah commented 6 years ago

This should not be closed

thiagocrepaldi commented 6 years ago

OpenMPI 2.x is not in the current roadmap, but contributions are really appreciated :)

thecompoundingdev commented 5 years ago

Re: Anyone with CNTK working from OpenMPI >=2?

datdinhquoc commented 5 years ago

uh, hey, why close, CNTK is still not working with OpenMPI 2

haixpham commented 5 years ago

uh, hey, why close, CNTK is still not working with OpenMPI 2

You can build OpenMPI 1.x from source and that's it, taking about 10 minutes. No pain no gain!

datdinhquoc commented 5 years ago

uh, hey, why close, CNTK is still not working with OpenMPI 2

You can build OpenMPI 1.x from source and that's it, taking about 10 minutes. No pain no gain!

yeah, real pain!