search

hclhkbu / dlbench

Benchmarking State-of-the-Art Deep Learning Software Tools
http://dlbench.comp.hkbu.edu.hk/
MIT License
170 stars 47 forks source link

Theano? #7

Open riturkki opened 7 years ago

riturkki commented 7 years ago

Thanks for the great benchmark!

Are you considering to include Theano in the future?

shyhuai commented 7 years ago

It may be great if there are more tools included. We will include some other existing popular tools for comparison in the future, but it may needs some time to update with more tools since we need to be very careful to make sure the networks' settings are all the same in different tools.

botev commented 7 years ago

Do you mind if I try to build the examples for Theano (single GPU only) and submit a PR?

shyhuai commented 7 years ago

That's good. Thanks for contributing to the codes of Theano examples.

botev commented 7 years ago

Could you however elaborate on the setup you have. From some of the code it seems you are using pytho2.7 rather than 3 and also virtual environemnts. Without the exact details it is quite hard to reproduce the benchmark on our own systems as well as just testing that integrating other frameworks would work

FreemanX commented 7 years ago

We are working on our documentation, and soon we will release a more detailed instructions for adding new tools. As for your specific questions:

  1. We are using python2.7 for our benchmark framework as well as deep learing tools that support python.
  2. The virtual environment was designed for old version of tensorflow. When we started this project, CUDA8.0 was just released and tensorflow didn't support it at that time. So we created an environment containing CUDA7.5 just for tensorflow. Now it's not necessary any more. If you encounter any questions, please don't hesitate to ask.

Thank you for your efforts!