macournoyer / neuralconvo

Neural conversational model in Torch
776 stars 347 forks source link

Support for mini-batches #29

Closed chenb67 closed 8 years ago

chenb67 commented 8 years ago

I haven't got to test the quality yet when using mini-batches, but speed-wise there is a significant change(looks like at least 10x speed-up).

We can further improve the speed using bucketing to save computations. I'll work on it when I have more time..

be sure to run luarocks install nn luarocks install rnn luarocks install dpnn

macournoyer commented 8 years ago

Awesome! Thanks a lot. Will give it a try this weekend.

macournoyer commented 8 years ago

Results didn't seem to be impacted and training time is (at least) cut in half on my machine.

Thanks a lot for this @chenb67, amazing work!