lmjohns3 / theanets

Neural network toolkit for Python
http://theanets.rtfd.org
MIT License
328 stars 73 forks source link

Distributed Computing Feature Request #20

Closed kadarakos closed 8 years ago

kadarakos commented 10 years ago

The theanets package is working perfectly for me so far its very easy to use and have enough features to solve my problem, so basically Good Job! My only issue is that I cannot use my available architecture to its fullest as I have access to a server of 26 cores and as far as I understand theanets does not have the ability to train a model on a cluster. I think it would make theanets more versatile and also way faster. If theanets would do cluster computing it would be my dream neural network package :-).

Cheers

majidaldo commented 9 years ago

theano itself might do automatic parallelization in the future. http://comments.gmane.org/gmane.comp.mathematics.theano.user/1639

kastnerkyle commented 9 years ago

There are at least two of us here at the lab working on that for Theano, but it is unknown when it will be finished. Don't hold your breath, but it is planned and in progress.

On Thu, Oct 9, 2014 at 2:32 PM, Majid alDosari notifications@github.com wrote:

theano itself might do automatic parallelization in the future. http://comments.gmane.org/gmane.comp.mathematics.theano.user/1639

— Reply to this email directly or view it on GitHub https://github.com/lmjohns3/theano-nets/issues/20#issuecomment-58555582.

nkundiushuti commented 9 years ago

I have access to an hpc cluster here but no gpu. It would be great to have something implemented for parallelization. I know that Theano is doing some effort regarding this.

lmjohns3 commented 8 years ago

With a heavy heart I'm going to close this since it's just going to be too broad for me to address by myself. If anyone wants to reopen, please create a new issue at lmjohns3/downhill, since that's where the actual optimization stuff happens.