elliottd / GroundedTranslation

Multilingual image description
https://staff.fnwi.uva.nl/d.elliott/GroundedTranslation/
BSD 3-Clause "New" or "Revised" License
46 stars 25 forks source link

Runtime evaluations on different hardware configurations #7

Closed elliottd closed 9 years ago

elliottd commented 9 years ago

I ran a job in CPU mode last night, which was a fortunate accident.

I now have the following running time information to share with @scfrank and @ehasler:

LSTM with --hidden _size=256, --optimiser=adagrad, on the IAPR-TC12 German dataset with no source language features.

Hardware Time / epoch
Tesla K20X 9 minutes
14 cores Intel Xeon E5-2650 16 minutes

(I have export OMP_NUM_THREADS=14 in ~/.basrc, the machine has 32 cores over four physical CPUs.)

scfrank commented 9 years ago

This may be relevant for CPU/GPU comparisons: https://github.com/Theano/Theano/issues/3029 https://github.com/Theano/Theano/issues/3321

(How to make GPUs deterministic and behave the same as CPUs wrt floating point ops.)