numenta / htm.java

Hierarchical Temporal Memory implementation in Java - an official Community-Driven Java port of the Numenta Platform for Intelligent Computing (NuPIC).
GNU Affero General Public License v3.0
310 stars 160 forks source link

Document performance comparison with nupic/ nupic.core #297

Open breznak opened 9 years ago

breznak commented 9 years ago

hi, I'd be interested in performance benchmark of the 3 implementations: java, py, c++? Specifically java against the two, as I'm aware of c++-py speeds.

I think a simple hotgym dataset (long version) with reasonable SP/TP settings would be all I'm asking for. I'll try to run the project in netbeans' profile mode.

OT: do you have any experience with interfacing python to java? As I have my other libs in python already..

cogmission commented 9 years ago

Hi,

Can the C++ implementation be counted as a full implementation yet? To my knowledge there's the linux on vm / py, linux on vm / py-c++ hybrid, (not sure about windows), mac py, mac py-c++ hybrid?

Also, I haven't done any performance optimization / profiling to speak of htm.java (yet) so it isn't at full capacity - but - running the integration tests and unit tests side by side in Eclipse its easy to see that the Java version at least very much outperforms the Python version. (I'm not sure if what I'm seeing is the pure Python or the Python-C++ hybrid either).

I would like to see these comparisons as well... Again keep in mind that I'm sure htm.java can use a performance profiling effort.

On Tue, Sep 1, 2015 at 12:12 PM, breznak notifications@github.com wrote:

hi, I'd be interested in performance benchmark of the 3 implementations: java, py, c++? Specifically java against the two, as I'm aware of c++-py speeds.

I think a simple hotgym dataset (long version) with reasonable SP/TP settings would be all I'm asking for. I'll try to run the project in netbeans' profile mode.

OT: do you have any experience with interfacing python to java? As I have my other libs in python already..

— Reply to this email directly or view it on GitHub https://github.com/numenta/htm.java/issues/297.

With kind regards,

David Ray Java Solutions Architect

Cortical.io http://cortical.io/ Sponsor of: HTM.java https://github.com/numenta/htm.java

d.ray@cortical.io http://cortical.io

cogmission commented 9 years ago

do you have any experience with interfacing python to java? As I have my other libs in python already..

Nope, I'm a Python noob... :-)

On Tue, Sep 1, 2015 at 12:40 PM, cogmission (David Ray) < cognitionmission@gmail.com> wrote:

Hi,

Can the C++ implementation be counted as a full implementation yet? To my knowledge there's the linux on vm / py, linux on vm / py-c++ hybrid, (not sure about windows), mac py, mac py-c++ hybrid?

Also, I haven't done any performance optimization / profiling to speak of htm.java (yet) so it isn't at full capacity - but - running the integration tests and unit tests side by side in Eclipse its easy to see that the Java version at least very much outperforms the Python version. (I'm not sure if what I'm seeing is the pure Python or the Python-C++ hybrid either).

I would like to see these comparisons as well... Again keep in mind that I'm sure htm.java can use a performance profiling effort.

On Tue, Sep 1, 2015 at 12:12 PM, breznak notifications@github.com wrote:

hi, I'd be interested in performance benchmark of the 3 implementations: java, py, c++? Specifically java against the two, as I'm aware of c++-py speeds.

I think a simple hotgym dataset (long version) with reasonable SP/TP settings would be all I'm asking for. I'll try to run the project in netbeans' profile mode.

OT: do you have any experience with interfacing python to java? As I have my other libs in python already..

— Reply to this email directly or view it on GitHub https://github.com/numenta/htm.java/issues/297.

With kind regards,

David Ray Java Solutions Architect

Cortical.io http://cortical.io/ Sponsor of: HTM.java https://github.com/numenta/htm.java

d.ray@cortical.io http://cortical.io

With kind regards,

David Ray Java Solutions Architect

Cortical.io http://cortical.io/ Sponsor of: HTM.java https://github.com/numenta/htm.java

d.ray@cortical.io http://cortical.io

cogmission commented 9 years ago

@breznak I assume when you referred to Netbeans that you were going to play around with this?