search

hclhkbu / dlbench

Benchmarking State-of-the-Art Deep Learning Software Tools
http://dlbench.comp.hkbu.edu.hk/
MIT License
170 stars 47 forks source link

Too old versions #11

Open magic282 opened 7 years ago

magic282 commented 7 years ago

Hi,

The versions of mxnet and tensorflow are too old. Could you update these tools and share the results. I tried to run the benchmark however it seems the code can hardly run on windows servers.

Thanks.

shyhuai commented 7 years ago

Hi, the test on the newest versions is on going. We will release the results after finished.

magic282 commented 7 years ago

It seems that recently mxnet 0.9.4 fixed a bug and can get better memory perfomance for bucket models, especially for RNN.

FreemanX commented 7 years ago

New scripts tested with mxnet0.9.5 have been updated.

magic282 commented 7 years ago

Great! Also, I am very curious about pytorch and torch. Are their performance comparable or not?