numenta / nupic-legacy

Numenta Platform for Intelligent Computing is an implementation of Hierarchical Temporal Memory (HTM), a theory of intelligence based strictly on the neuroscience of the neocortex.
http://numenta.org/
GNU Affero General Public License v3.0
6.33k stars 1.56k forks source link

Establish a community-managed VM solution #341

Closed rhyolight closed 10 years ago

rhyolight commented 10 years ago

We need a community-managed VM that contains NuPIC already installed with all dependencies, ready to run. All tests should run and pass, including swarming. This should include documentation about how to run the VM from scratch, as well as the latest commit SHA of NuPIC it has been tested with.

Ideally, a newbie from any environment should be able to get NuPIC up-and-running, with all tests passing and sample apps running, within an hour in a VM (hopefully less!). Organized documentation and a drop-dead simple installation is extremely important.

breznak commented 10 years ago

alternatively you can use the virtualbox VM http://comments.gmane.org/gmane.comp.ai.nupic/1016

rhyolight commented 10 years ago

Haven't heard much about this issue lately. Any progress with Docker?

jefffohl commented 10 years ago

I haven't spent as much time on this in the last few weeks as I had hoped. My day job responsibilities ballooned in recent weeks. I am still looking forward to checking out the Docker file. In the meantime, I still have the torrent of the VM available for seeding.

On Wed, Dec 11, 2013 at 3:43 PM, Matthew Taylor notifications@github.comwrote:

Haven't heard much about this issue lately. Any progress with Docker?

— Reply to this email directly or view it on GitHubhttps://github.com/numenta/nupic/issues/341#issuecomment-30376450 .

unixorn commented 10 years ago

We do have the nupic-chef repo that is the chef cookbooks I used to build the original hackathon VM for vagrant and Virtualbox.

dfowler7437 commented 10 years ago

I am trying to get setup and am failing. I tried the Vagrant on a Mac Book Pro running Win8.1, Vagrant cant see Virtual box, times out. I can see the VM running but it needs some special setting I cant change in the BIOS cause Macs don't have a BIOS like PCs do.

I did do the Vagrant tutorial and got a VM with Ubuntu working.

I moved to an IMac running Mavricks and tried again, same issue with Vagrant timing out. I can run the VM directly but don't know what to enter for the login.

Is it possible to work from the console of the VM? If so, how do I log in?

jefffohl commented 10 years ago

Try this for login/password: nupic/nupic

If you still have trouble, there is a Docker file that works well made by Allan Costa, which you can find here: https://index.docker.io/u/allanino/nupic/

To set up Docker, you will need to work on a Linux machine. So, if you are working on OSX, you will need to make a virtual machine. Docker has steps on how to set up for OSX here: http://docs.docker.io/en/latest/installation/vagrant/ On the last step, where it says, "sudo docker", you will want to do that from a directory where the Dockerfile linked above is located.

If you need further help, let me know.

On Sat, Jan 4, 2014 at 11:57 PM, dfowler7437 notifications@github.comwrote:

I am trying to get setup and am failing. I tried the Vagrant on a Mac Book Pro running Win8.1, Vagrant cant see Virtual box, times out. I can see the VM running but it needs some special setting I cant change in the BIOS cause Macs don't have a BIOS like PCs do.

I did do the Vagrant tutorial and got a VM with Ubuntu working.

I moved to an IMac running Mavricks and tried again, same issue with Vagrant timing out. I can run the VM directly but don't know what to enter for the login.

Is it possible to work from the console of the VM? If so, how do I log in?

— Reply to this email directly or view it on GitHubhttps://github.com/numenta/nupic/issues/341#issuecomment-31598717 .

dfowler7437 commented 10 years ago

Awesome! thanks for the reply.. nupic/nupic did not work. Thank you for the help.

I did the docker, even though the hello world example, then started the steps you pointed me to but failed at. wget https://bitbucket.org/pypa/setuptools/raw/bootstrap/ez_setup.py -O - | python;\ wget https://raw.github.com/pypa/pip/master/contrib/get-pip.py -O - | python;\ I used “sudo” but still, fail. The error is below.

vagrant@precise64:~$ sudo wget https://bitbucket.org/pypa/setuptools/raw/bootstrap/ez_setup.py -O - | python; --2014-01-06 07:06:14-- https://bitbucket.org/pypa/setuptools/raw/bootstrap/ez_setup.py Resolving bitbucket.org (bitbucket.org)... 131.103.20.167, 131.103.20.168 Connecting to bitbucket.org (bitbucket.org)|131.103.20.167|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 11371 (11K) [text/plain] Saving to: `STDOUT'

100%[======================================>] 11,371 --.-K/s in 0.001s

2014-01-06 07:06:14 (7.89 MB/s) - written to stdout [11371/11371]

Extracting in /tmp/tmpekbOEH Now working in /tmp/tmpekbOEH/setuptools-2.0.2 Installing Setuptools running install error: can't create or remove files in install directory

The following error occurred while trying to add or remove files in the installation directory:

[Errno 13] Permission denied: '/usr/local/lib/python2.7/dist-packages/test-easy-install-7741.write-test'

The installation directory you specified (via --install-dir, --prefix, or the distutils default setting) was:

/usr/local/lib/python2.7/dist-packages/

Perhaps your account does not have write access to this directory? If the installation directory is a system-owned directory, you may need to sign in as the administrator or "root" account. If you do not have administrative access to this machine, you may wish to choose a different installation directory, preferably one that is listed in your PYTHONPATH environment variable.

For information on other options, you may wish to consult the documentation at:

https://pythonhosted.org/setuptools/easy_install.html

Please make the appropriate changes for your system and try again.

Something went wrong during the installation. See the error message above. vagrant@precise64:~$ On Jan 5, 2014, at 9:07 PM, Jeff Fohl notifications@github.com wrote:

Try this for login/password: nupic/nupic

If you still have trouble, there is a Docker file that works well made by Allan Costa, which you can find here: https://index.docker.io/u/allanino/nupic/

To set up Docker, you will need to work on a Linux machine. So, if you are working on OSX, you will need to make a virtual machine. Docker has steps on how to set up for OSX here: http://docs.docker.io/en/latest/installation/vagrant/ On the last step, where it says, "sudo docker", you will want to do that from a directory where the Dockerfile linked above is located.

If you need further help, let me know.

  • Jeff

On Sat, Jan 4, 2014 at 11:57 PM, dfowler7437 notifications@github.comwrote:

I am trying to get setup and am failing. I tried the Vagrant on a Mac Book Pro running Win8.1, Vagrant cant see Virtual box, times out. I can see the VM running but it needs some special setting I cant change in the BIOS cause Macs don't have a BIOS like PCs do.

I did do the Vagrant tutorial and got a VM with Ubuntu working.

I moved to an IMac running Mavricks and tried again, same issue with Vagrant timing out. I can run the VM directly but don't know what to enter for the login.

Is it possible to work from the console of the VM? If so, how do I log in?

— Reply to this email directly or view it on GitHubhttps://github.com/numenta/nupic/issues/341#issuecomment-31598717 .

— Reply to this email directly or view it on GitHub.

jefffohl commented 10 years ago

What is your host operating system?

dfowler7437 commented 10 years ago

OSX 10.9.1

On Jan 6, 2014, at 10:59 AM, Jeff Fohl notifications@github.com wrote:

What is your host operating system?

— Reply to this email directly or view it on GitHub.

jefffohl commented 10 years ago

What was the command that you entered which resulted in the error?

On Mon, Jan 6, 2014 at 9:03 AM, dfowler7437 notifications@github.comwrote:

OSX 10.9.1

On Jan 6, 2014, at 10:59 AM, Jeff Fohl notifications@github.com wrote:

What is your host operating system?

— Reply to this email directly or view it on GitHub.

— Reply to this email directly or view it on GitHubhttps://github.com/numenta/nupic/issues/341#issuecomment-31665307 .

jefffohl commented 10 years ago

Allan wrote some steps on how to use his file here, on his Github page: https://github.com/allanino/docker-nupic

I would recommend trying these steps.

dfowler7437 commented 10 years ago

On Jan 6, 2014, at 11:03 AM, David Fowler david.fowler@gmail.com wrote:

OSX 10.9.1

On Jan 6, 2014, at 10:59 AM, Jeff Fohl notifications@github.com wrote:

What is your host operating system?

— Reply to this email directly or view it on GitHub.

wget https://bitbucket.org/pypa/setuptools/raw/bootstrap/ez_setup.py -O - | python;\ wget https://raw.github.com/pypa/pip/master/contrib/get-pip.py -O - | python;\ I used “sudo” but still, fail. The error is below.

vagrant@precise64:~$ sudo wget https://bitbucket.org/pypa/setuptools/raw/bootstrap/ez_setup.py -O - | python; --2014-01-06 07:06:14-- https://bitbucket.org/pypa/setuptools/raw/bootstrap/ez_setup.py Resolving bitbucket.org (bitbucket.org)... 131.103.20.167, 131.103.20.168 Connecting to bitbucket.org (bitbucket.org)|131.103.20.167|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 11371 (11K) [text/plain] Saving to: `STDOUT'

100%[======================================>] 11,371 --.-K/s in 0.001s

2014-01-06 07:06:14 (7.89 MB/s) - written to stdout [11371/11371]

Extracting in /tmp/tmpekbOEH Now working in /tmp/tmpekbOEH/setuptools-2.0.2 Installing Setuptools running install error: can't create or remove files in install directory

The following error occurred while trying to add or remove files in the installation directory:

[Errno 13] Permission denied: '/usr/local/lib/python2.7/dist-packages/test-easy-install-7741.write-test'

The installation directory you specified (via --install-dir, --prefix, or the distutils default setting) was:

/usr/local/lib/python2.7/dist-packages/

Perhaps your account does not have write access to this directory? If the installation directory is a system-owned directory, you may need to sign in as the administrator or "root" account. If you do not have administrative access to this machine, you may wish to choose a different installation directory, preferably one that is listed in your PYTHONPATH environment variable.

For information on other options, you may wish to consult the documentation at:

https://pythonhosted.org/setuptools/easy_install.html

Please make the appropriate changes for your system and try again.

Something went wrong during the installation. See the error message above. vagrant@precise64:~$

jefffohl commented 10 years ago

I think I am getting mixed up as to where you are with the installation. I just wrote up a wiki page on how to get things running using Docker here: https://github.com/numenta/nupic/wiki/Install-NuPIC-using-Docker

Perhaps walk through those steps, and see if you can get things running?

On Mon, Jan 6, 2014 at 11:40 AM, dfowler7437 notifications@github.comwrote:

On Jan 6, 2014, at 11:03 AM, David Fowler david.fowler@gmail.com wrote:

OSX 10.9.1

On Jan 6, 2014, at 10:59 AM, Jeff Fohl notifications@github.com wrote:

What is your host operating system?

— Reply to this email directly or view it on GitHub.

wget https://bitbucket.org/pypa/setuptools/raw/bootstrap/ez_setup.py -O - | python;\ wget https://raw.github.com/pypa/pip/master/contrib/get-pip.py -O - | python;\ I used “sudo” but still, fail. The error is below.

vagrant@precise64:~$ sudo wget https://bitbucket.org/pypa/setuptools/raw/bootstrap/ez_setup.py -O - | python; --2014-01-06 07:06:14-- https://bitbucket.org/pypa/setuptools/raw/bootstrap/ez_setup.py Resolving bitbucket.org (bitbucket.org)... 131.103.20.167, 131.103.20.168 Connecting to bitbucket.org (bitbucket.org)|131.103.20.167|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 11371 (11K) [text/plain] Saving to: `STDOUT'

100%[======================================>] 11,371 --.-K/s in 0.001s

2014-01-06 07:06:14 (7.89 MB/s) - written to stdout [11371/11371]

Extracting in /tmp/tmpekbOEH Now working in /tmp/tmpekbOEH/setuptools-2.0.2 Installing Setuptools running install error: can't create or remove files in install directory

The following error occurred while trying to add or remove files in the installation directory:

[Errno 13] Permission denied: '/usr/local/lib/python2.7/dist-packages/test-easy-install-7741.write-test'

The installation directory you specified (via --install-dir, --prefix, or the distutils default setting) was:

/usr/local/lib/python2.7/dist-packages/

Perhaps your account does not have write access to this directory? If the installation directory is a system-owned directory, you may need to sign in as the administrator or "root" account. If you do not have administrative access to this machine, you may wish to choose a different installation directory, preferably one that is listed in your PYTHONPATH environment variable.

For information on other options, you may wish to consult the documentation at:

https://pythonhosted.org/setuptools/easy_install.html

Please make the appropriate changes for your system and try again.

Something went wrong during the installation. See the error message above. vagrant@precise64:~$

Reply to this email directly or view it on GitHubhttps://github.com/numenta/nupic/issues/341#issuecomment-31679613 .

dfowler7437 commented 10 years ago

I am working with the last set of instructions you sent now. doing the pull right now. I’m hopeful..

Thank you so much for this effort.

On Jan 6, 2014, at 1:55 PM, Jeff Fohl notifications@github.com wrote:

I think I am getting mixed up as to where you are with the installation. I just wrote up a wiki page on how to get things running using Docker here: https://github.com/numenta/nupic/wiki/Install-NuPIC-using-Docker

Perhaps walk through those steps, and see if you can get things running?

  • Jeff

On Mon, Jan 6, 2014 at 11:40 AM, dfowler7437 notifications@github.comwrote:

On Jan 6, 2014, at 11:03 AM, David Fowler david.fowler@gmail.com wrote:

OSX 10.9.1

On Jan 6, 2014, at 10:59 AM, Jeff Fohl notifications@github.com wrote:

What is your host operating system?

— Reply to this email directly or view it on GitHub.

wget https://bitbucket.org/pypa/setuptools/raw/bootstrap/ez_setup.py -O - | python;\ wget https://raw.github.com/pypa/pip/master/contrib/get-pip.py -O - | python;\ I used “sudo” but still, fail. The error is below.

vagrant@precise64:~$ sudo wget https://bitbucket.org/pypa/setuptools/raw/bootstrap/ez_setup.py -O - | python; --2014-01-06 07:06:14-- https://bitbucket.org/pypa/setuptools/raw/bootstrap/ez_setup.py Resolving bitbucket.org (bitbucket.org)... 131.103.20.167, 131.103.20.168 Connecting to bitbucket.org (bitbucket.org)|131.103.20.167|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 11371 (11K) [text/plain] Saving to: `STDOUT'

100%[======================================>] 11,371 --.-K/s in 0.001s

2014-01-06 07:06:14 (7.89 MB/s) - written to stdout [11371/11371]

Extracting in /tmp/tmpekbOEH Now working in /tmp/tmpekbOEH/setuptools-2.0.2 Installing Setuptools running install error: can't create or remove files in install directory

The following error occurred while trying to add or remove files in the installation directory:

[Errno 13] Permission denied: '/usr/local/lib/python2.7/dist-packages/test-easy-install-7741.write-test'

The installation directory you specified (via --install-dir, --prefix, or the distutils default setting) was:

/usr/local/lib/python2.7/dist-packages/

Perhaps your account does not have write access to this directory? If the installation directory is a system-owned directory, you may need to sign in as the administrator or "root" account. If you do not have administrative access to this machine, you may wish to choose a different installation directory, preferably one that is listed in your PYTHONPATH environment variable.

For information on other options, you may wish to consult the documentation at:

https://pythonhosted.org/setuptools/easy_install.html

Please make the appropriate changes for your system and try again.

Something went wrong during the installation. See the error message above. vagrant@precise64:~$

Reply to this email directly or view it on GitHubhttps://github.com/numenta/nupic/issues/341#issuecomment-31679613 .

— Reply to this email directly or view it on GitHub.

dfowler7437 commented 10 years ago

New error…

vagrant@precise64:/etc/apt$ sudo docker pull allanino/nupic Pulling repository allanino/nupic 126d0bdc5d96: Error pulling image (latest) from allanino/nupic, endpoint: https:126d0bdc5d96: Error pulling image (latest) from allanino/nupic, exit status 2: gzip: stdin: unexpected end of file tar: Unexpected EOF in archivee tar: Unexpected EOF in archiveg dependent layers tar: Error is not recoverable: exiting now 2014/01/06 20:38:38 Could not find repository on any of the indexed registries. vagrant@precise64:/etc/apt$

On Jan 6, 2014, at 1:55 PM, Jeff Fohl notifications@github.com wrote:

I think I am getting mixed up as to where you are with the installation. I just wrote up a wiki page on how to get things running using Docker here: https://github.com/numenta/nupic/wiki/Install-NuPIC-using-Docker

Perhaps walk through those steps, and see if you can get things running?

  • Jeff

On Mon, Jan 6, 2014 at 11:40 AM, dfowler7437 notifications@github.comwrote:

On Jan 6, 2014, at 11:03 AM, David Fowler david.fowler@gmail.com wrote:

OSX 10.9.1

On Jan 6, 2014, at 10:59 AM, Jeff Fohl notifications@github.com wrote:

What is your host operating system?

— Reply to this email directly or view it on GitHub.

wget https://bitbucket.org/pypa/setuptools/raw/bootstrap/ez_setup.py -O - | python;\ wget https://raw.github.com/pypa/pip/master/contrib/get-pip.py -O - | python;\ I used “sudo” but still, fail. The error is below.

vagrant@precise64:~$ sudo wget https://bitbucket.org/pypa/setuptools/raw/bootstrap/ez_setup.py -O - | python; --2014-01-06 07:06:14-- https://bitbucket.org/pypa/setuptools/raw/bootstrap/ez_setup.py Resolving bitbucket.org (bitbucket.org)... 131.103.20.167, 131.103.20.168 Connecting to bitbucket.org (bitbucket.org)|131.103.20.167|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 11371 (11K) [text/plain] Saving to: `STDOUT'

100%[======================================>] 11,371 --.-K/s in 0.001s

2014-01-06 07:06:14 (7.89 MB/s) - written to stdout [11371/11371]

Extracting in /tmp/tmpekbOEH Now working in /tmp/tmpekbOEH/setuptools-2.0.2 Installing Setuptools running install error: can't create or remove files in install directory

The following error occurred while trying to add or remove files in the installation directory:

[Errno 13] Permission denied: '/usr/local/lib/python2.7/dist-packages/test-easy-install-7741.write-test'

The installation directory you specified (via --install-dir, --prefix, or the distutils default setting) was:

/usr/local/lib/python2.7/dist-packages/

Perhaps your account does not have write access to this directory? If the installation directory is a system-owned directory, you may need to sign in as the administrator or "root" account. If you do not have administrative access to this machine, you may wish to choose a different installation directory, preferably one that is listed in your PYTHONPATH environment variable.

For information on other options, you may wish to consult the documentation at:

https://pythonhosted.org/setuptools/easy_install.html

Please make the appropriate changes for your system and try again.

Something went wrong during the installation. See the error message above. vagrant@precise64:~$

Reply to this email directly or view it on GitHubhttps://github.com/numenta/nupic/issues/341#issuecomment-31679613 .

— Reply to this email directly or view it on GitHub.

rhyolight commented 10 years ago

Download problem? Have you tried running it again? How is your network connectivity?


Matt Taylor OS Community Flag-Bearer Numenta

On Mon, Jan 6, 2014 at 12:43 PM, dfowler7437 notifications@github.comwrote:

New error…

vagrant@precise64:/etc/apt$ sudo docker pull allanino/nupic Pulling repository allanino/nupic 126d0bdc5d96: Error pulling image (latest) from allanino/nupic, endpoint: https:126d0bdc5d96: Error pulling image (latest) from allanino/nupic, exit status 2: gzip: stdin: unexpected end of file tar: Unexpected EOF in archivee tar: Unexpected EOF in archiveg dependent layers tar: Error is not recoverable: exiting now 2014/01/06 20:38:38 Could not find repository on any of the indexed registries. vagrant@precise64:/etc/apt$

On Jan 6, 2014, at 1:55 PM, Jeff Fohl notifications@github.com wrote:

I think I am getting mixed up as to where you are with the installation. I just wrote up a wiki page on how to get things running using Docker here: https://github.com/numenta/nupic/wiki/Install-NuPIC-using-Docker

Perhaps walk through those steps, and see if you can get things running?

  • Jeff

On Mon, Jan 6, 2014 at 11:40 AM, dfowler7437 notifications@github.comwrote:

On Jan 6, 2014, at 11:03 AM, David Fowler david.fowler@gmail.com wrote:

OSX 10.9.1

On Jan 6, 2014, at 10:59 AM, Jeff Fohl notifications@github.com wrote:

What is your host operating system?

— Reply to this email directly or view it on GitHub.

wget https://bitbucket.org/pypa/setuptools/raw/bootstrap/ez_setup.py-O - | python;\ wget https://raw.github.com/pypa/pip/master/contrib/get-pip.py -O - | python;\ I used “sudo” but still, fail. The error is below.

vagrant@precise64:~$ sudo wget https://bitbucket.org/pypa/setuptools/raw/bootstrap/ez_setup.py -O - | python; --2014-01-06 07:06:14-- https://bitbucket.org/pypa/setuptools/raw/bootstrap/ez_setup.py Resolving bitbucket.org (bitbucket.org)... 131.103.20.167, 131.103.20.168 Connecting to bitbucket.org (bitbucket.org)|131.103.20.167|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 11371 (11K) [text/plain] Saving to: `STDOUT'

100%[======================================>] 11,371 --.-K/s in 0.001s

2014-01-06 07:06:14 (7.89 MB/s) - written to stdout [11371/11371]

Extracting in /tmp/tmpekbOEH Now working in /tmp/tmpekbOEH/setuptools-2.0.2 Installing Setuptools running install error: can't create or remove files in install directory

The following error occurred while trying to add or remove files in the installation directory:

[Errno 13] Permission denied:

'/usr/local/lib/python2.7/dist-packages/test-easy-install-7741.write-test'

The installation directory you specified (via --install-dir, --prefix, or the distutils default setting) was:

/usr/local/lib/python2.7/dist-packages/

Perhaps your account does not have write access to this directory? If the installation directory is a system-owned directory, you may need to sign in as the administrator or "root" account. If you do not have administrative access to this machine, you may wish to choose a different installation directory, preferably one that is listed in your PYTHONPATH environment variable.

For information on other options, you may wish to consult the documentation at:

https://pythonhosted.org/setuptools/easy_install.html

Please make the appropriate changes for your system and try again.

Something went wrong during the installation. See the error message above. vagrant@precise64:~$

Reply to this email directly or view it on GitHub< https://github.com/numenta/nupic/issues/341#issuecomment-31679613> .

— Reply to this email directly or view it on GitHub.

— Reply to this email directly or view it on GitHubhttps://github.com/numenta/nupic/issues/341#issuecomment-31685083 .

dfowler7437 commented 10 years ago

Success!

There are some test fails, results from both test runs are included below.

Do I have a normal setup now?

vagrant@precise64:~$ sudo docker run allanino/nupic /bin/bash -c "cd /usr/bin/nta/eng/;./bin/run_tests.sh" ============================= test session starts ============================== platform linux2 -- Python 2.7.3 -- pytest-2.4.2 -- /usr/bin/python plugins: cov, xdist collecting ... collected 639 items / 2 skipped

tests/external/py2/asteval_test.py:32: TestCase.testImportAndVersions PASSED tests/external/py2/testfixture_test.py:48: TestPytest.testSetUpModuleCalled PASSEDvagrant@precise64:~$

vagrant@precise64:~$ sudo docker run allanino/nupic /bin/bash -c "/usr/bin/nta/eng/bin/testeverything" Tester -- creating testoutput directory /home/docker/testeverything.out Executing tests matching the regular expression ".*" Found 39 test sets WARNING: Caught exception: This exception should get caught. ======= Tests for TesterTest ============== Total tests: 10, Failures: 4, Disabled : 0 WARNING: Critical failure ocurred PASS Integer test, should succeed (line: 45) Expected result: 1 Actual result: 1 PASS Double test, should succeed (line: 46) Expected result: 23.42 Actual result: 23.42 PASS String test, should succeed (line: 47) Expected result: Numenta Actual result: Numenta FAIL Integer test, should fail (line: 50) Expected result: 1 Actual result: 0 FAIL Double test, should fail (line: 51) Expected result: 23.42 Actual result: 23.421 FAIL String test, should fail (line: 52) Expected result: Numenta Actual result: Numenta PASS Max test (line: 55) Expected result: 23.3 Actual result: 23.3 PASS Min test (line: 56) Expected result: 23.2 Actual result: 23.2 PASS Max test (line: 57) Expected result: b Actual result: b PASS Min test (line: 58) Expected result: a Actual result: a ======= Done with TesterTest tests ===========

ERROR: Invalid NTA_BasicType -1 used in array constructor [/usr/local/src/nupic/nta/ntypes/ArrayBase.cpp line 59] ERROR: allocateBuffer -- buffer already set. Use releaseBuffer first [/usr/local/src/nupic/nta/ntypes/ArrayBase.cpp line 80] ERROR: allocateBuffer -- buffer already set. Use releaseBuffer first [/usr/local/src/nupic/nta/ntypes/ArrayBase.cpp line 80] ERROR: setBuffer -- buffer already set. Use releaseBuffer first [/usr/local/src/nupic/nta/ntypes/ArrayBase.cpp line 97] ======= Tests for ArrayTest ============== Total tests: 72, Failures: 0, Disabled : 0 All tests passed ======= Done with ArrayTest tests ===========

======= Tests for BasicTypeTest ============== Total tests: 47, Failures: 0, Disabled : 0 All tests passed ======= Done with BasicTypeTest tests ===========

INFO: xo[0]={8.8 6 c 'ABCD' -0.04 INFO: xo[1]={4.5 6 t 'XBCD' 3.14 INFO: xo[0]={8.8 6 c 'ABCD' -0.04 '100,101,102' INFO: xo[1]={4.5 6 t 'XBCD' 3.14 '-999,101,102' ======= Tests for BufferTest ============== Total tests: 94, Failures: 0, Disabled : 0 All tests passed ======= Done with BufferTest tests ===========

ERROR: CHECK FAILED: "index < vec.size()" [/usr/local/src/nupic/nta/ntypes/Collection.cpp line 70] ERROR: No item named: blah [/usr/local/src/nupic/nta/ntypes/Collection.cpp line 95] ERROR: CHECK FAILED: "index < vec.size()" [/usr/local/src/nupic/nta/ntypes/Collection.cpp line 70] ERROR: No item named: blah [/usr/local/src/nupic/nta/ntypes/Collection.cpp line 95] ERROR: CHECK FAILED: "index < vec.size()" [/usr/local/src/nupic/nta/ntypes/Collection.cpp line 70] ERROR: No item named: blah [/usr/local/src/nupic/nta/ntypes/Collection.cpp line 95] ERROR: CHECK FAILED: "index < vec.size()" [/usr/local/src/nupic/nta/ntypes/Collection.cpp line 70] ERROR: No item named: blah [/usr/local/src/nupic/nta/ntypes/Collection.cpp line 95] ERROR: Unable to add item '0' to collection because it already exists [/usr/local/src/nupic/nta/ntypes/Collection.cpp line 107] ERROR: Unable to add item '1' to collection because it already exists [/usr/local/src/nupic/nta/ntypes/Collection.cpp line 107] ERROR: Unable to add item '2' to collection because it already exists [/usr/local/src/nupic/nta/ntypes/Collection.cpp line 107] ERROR: No item named '4' in collection [/usr/local/src/nupic/nta/ntypes/Collection.cpp line 127] ERROR: No item named '1' in collection [/usr/local/src/nupic/nta/ntypes/Collection.cpp line 127] ERROR: Unable to add item '0' to collection because it already exists [/usr/local/src/nupic/nta/ntypes/Collection.cpp line 107] ERROR: Unable to add item '1' to collection because it already exists [/usr/local/src/nupic/nta/ntypes/Collection.cpp line 107] ERROR: Unable to add item '2' to collection because it already exists [/usr/local/src/nupic/nta/ntypes/Collection.cpp line 107] ERROR: No item named '1' in collection [/usr/local/src/nupic/nta/ntypes/Collection.cpp line 127] ERROR: No item named '0' in collection [/usr/local/src/nupic/nta/ntypes/Collection.cpp line 127] ======= Tests for CollectionTest ============== Total tests: 199, Failures: 0, Disabled : 0 All tests passed ======= Done with CollectionTest tests ===========

======= Tests for CondProbTableTest ============== Total tests: 115, Failures: 0, Disabled : 0 All tests passed ======= Done with CondProbTableTest tests ===========

======= Tests for DenseTensorUnitTest ============== Total tests: 0, Failures: 0, Disabled : 0 All tests passed ======= Done with DenseTensorUnitTest tests ===========

ERROR: Attempt to get count from dimensions [unspecified] [/usr/local/src/nupic/nta/ntypes/Dimensions.cpp line 57] ERROR: Bad request for dimension 0 on [unspecified] [/usr/local/src/nupic/nta/ntypes/Dimensions.cpp line 78] ERROR: Invalid coordinate [1 2] for Dimensions [unspecified] [/usr/local/src/nupic/nta/ntypes/Dimensions.cpp line 171] ERROR: Attempt to get count from dimensions [unspecified] [/usr/local/src/nupic/nta/ntypes/Dimensions.cpp line 57] ERROR: Bad request for dimension 0 on [unspecified] [/usr/local/src/nupic/nta/ntypes/Dimensions.cpp line 78] ERROR: Invalid coordinate index 0 of 0 is too large for region dimensions [dontcare] [/usr/local/src/nupic/nta/ntypes/Dimensions.cpp line 189] ERROR: Attempt to get count from dimensions [dontcare] [/usr/local/src/nupic/nta/ntypes/Dimensions.cpp line 57] ERROR: Invalid coordinate index 0 of 1 is too large for region dimensions 1 0 [/usr/local/src/nupic/nta/ntypes/Dimensions.cpp line 189] ERROR: Attempt to get count from invalid dimensions 1 0 [/usr/local/src/nupic/nta/ntypes/Dimensions.cpp line 62] ERROR: Bad request for dimension 2 on 1 0 [/usr/local/src/nupic/nta/ntypes/Dimensions.cpp line 78] ERROR: Bad request for dimension 2 on [2 3] [/usr/local/src/nupic/nta/ntypes/Dimensions.cpp line 78] ERROR: Bad request for dimension 2 on [2 5] [/usr/local/src/nupic/nta/ntypes/Dimensions.cpp line 78] ======= Tests for DimensionsTest ============== Total tests: 205, Failures: 0, Disabled : 0 All tests passed ======= Done with DimensionsTest tests ===========

ERROR: Directory::create -- failed to create directory "/home/docker/someDir/someSubDir". OS Error: No such file or directory [/usr/local/src/nupic/nta/os/Directory.cpp line 248] ======= Tests for DirectoryTest ============== Total tests: 32, Failures: 0, Disabled : 0 All tests passed ======= Done with DirectoryTest tests ===========

======= Tests for DomainUnitTest ============== Total tests: 0, Failures: 0, Disabled : 0 All tests passed ======= Done with DomainUnitTest tests ===========

Looking for path '/usr/bin/nta/eng/lib/libcpp_region.so' ======= Tests for DynamicLibraryTest ============== Total tests: 11, Failures: 0, Disabled : 0 All tests passed ======= Done with DynamicLibraryTest tests ===========

======= Tests for EnvTest ============== Total tests: 10, Failures: 0, Disabled : 0 All tests passed ======= Done with EnvTest tests ===========

======= Tests for ExceptionTest ============== Total tests: 8, Failures: 0, Disabled : 0 All tests passed ======= Done with ExceptionTest tests ===========

======= Tests for FastCLAClassifierTest ============== Total tests: 0, Failures: 0, Disabled : 0 All tests passed ======= Done with FastCLAClassifierTest tests ===========

======= Tests for FlatSpatialPoolerTest ============== Total tests: 0, Failures: 0, Disabled : 0 All tests passed ======= Done with FlatSpatialPoolerTest tests ===========

======= Tests for FractionTest ============== Total tests: 189, Failures: 0, Disabled : 0 All tests passed ======= Done with FractionTest tests ===========

======= Tests for IndexUnitTest ============== Total tests: 0, Failures: 0, Disabled : 0 All tests passed ======= Done with IndexUnitTest tests ===========

ERROR: Attempt to create Input with a null region [/usr/local/src/nupic/nta/engine/Input.cpp line 47] ERROR: Invalid NTABasicType 11 used in array constructor [/usr/local/src/nupic/nta/ntypes/ArrayBase.cpp line 59] ERROR: Input region's dimensions are unspecified when Input::initialize() was called. Region's dimensions must be specified. [/usr/local/src/nupic/nta/engine/Input.cpp line 534] ERROR: Input region's dimensions are unspecified when Input::initialize() was called. Region's dimensions must be specified. [/usr/local/src/nupic/nta/engine/Input.cpp line 534] ERROR: Cannot remove link [region1.bottomUpOut (region dims: [8 4]) to region2.bottomUpIn (region dims: [4 2]) type: TestFanIn2] because destination region region2 is initialized. Remove the region first. [/usr/local/src/nupic/nta/engine/Input.cpp line 106] ERROR: Cannot remove link [region1.bottomUpOut (region dims: [8 4]) to region2.bottomUpIn (region dims: [4 2]) type: TestFanIn2] because destination region region2 is initialized. Remove the region first. [/usr/local/src/nupic/nta/engine/Input.cpp line 106] ERROR: Unable to remove region 'region1' because it has one or more outgoing links [/usr/local/src/nupic/nta/engine/Network.cpp line 257] ERROR: CHECK FAILED: "linkiter != links.end()" [/usr/local/src/nupic/nta/engine/Input.cpp line 103] ERROR: CHECK FAILED: "linkiter != links.end()" [/usr/local/src/nupic/nta/engine/Input.cpp line 103] ERROR: CHECK FAILED: "linkiter != links.end()" [/usr/local/src/nupic/nta/engine/Input.cpp line 103] ======= Tests for InputTest ============== Total tests: 88, Failures: 0, Disabled : 0 All tests passed ======= Done with InputTest tests ===========

======= Tests for MathsTest ============== Total tests: 0, Failures: 0, Disabled : 0 All tests passed ======= Done with MathsTest tests ===========

ERROR: CHECK FAILED: "cP < endP" MemParser::get(string&) - EOF [/usr/local/src/nupic/nta/ntypes/MemParser.cpp line 212] ERROR: CHECK FAILED: "cP < endP" MemParser::get(string&) - EOF [/usr/local/src/nupic/nta/ntypes/MemParser.cpp line 212] ERROR: CHECK FAILED: "cP < endP" MemParser::get(string&) - EOF [/usr/local/src/nupic/nta/ntypes/MemParser.cpp line 212] ERROR: CHECK FAILED: "endP != startP && endP <= endP_" MemParser::get(long&) - parse error, not a valid integer [/usr/local/src/nupic/nta/ntypes/MemParser.cpp line 142] vagrant@precise64:~$

On Jan 6, 2014, at 2:48 PM, Matthew Taylor notifications@github.com wrote:

Download problem? Have you tried running it again? How is your network connectivity?


Matt Taylor OS Community Flag-Bearer Numenta

On Mon, Jan 6, 2014 at 12:43 PM, dfowler7437 notifications@github.comwrote:

New error…

vagrant@precise64:/etc/apt$ sudo docker pull allanino/nupic Pulling repository allanino/nupic 126d0bdc5d96: Error pulling image (latest) from allanino/nupic, endpoint: https:126d0bdc5d96: Error pulling image (latest) from allanino/nupic, exit status 2: gzip: stdin: unexpected end of file tar: Unexpected EOF in archivee tar: Unexpected EOF in archiveg dependent layers tar: Error is not recoverable: exiting now 2014/01/06 20:38:38 Could not find repository on any of the indexed registries. vagrant@precise64:/etc/apt$

On Jan 6, 2014, at 1:55 PM, Jeff Fohl notifications@github.com wrote:

I think I am getting mixed up as to where you are with the installation. I just wrote up a wiki page on how to get things running using Docker here: https://github.com/numenta/nupic/wiki/Install-NuPIC-using-Docker

Perhaps walk through those steps, and see if you can get things running?

  • Jeff

On Mon, Jan 6, 2014 at 11:40 AM, dfowler7437 notifications@github.comwrote:

On Jan 6, 2014, at 11:03 AM, David Fowler david.fowler@gmail.com wrote:

OSX 10.9.1

On Jan 6, 2014, at 10:59 AM, Jeff Fohl notifications@github.com wrote:

What is your host operating system?

— Reply to this email directly or view it on GitHub.

wget https://bitbucket.org/pypa/setuptools/raw/bootstrap/ez_setup.py-O - | python;\ wget https://raw.github.com/pypa/pip/master/contrib/get-pip.py -O - | python;\ I used “sudo” but still, fail. The error is below.

vagrant@precise64:~$ sudo wget https://bitbucket.org/pypa/setuptools/raw/bootstrap/ez_setup.py -O - | python; --2014-01-06 07:06:14-- https://bitbucket.org/pypa/setuptools/raw/bootstrap/ez_setup.py Resolving bitbucket.org (bitbucket.org)... 131.103.20.167, 131.103.20.168 Connecting to bitbucket.org (bitbucket.org)|131.103.20.167|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 11371 (11K) [text/plain] Saving to: `STDOUT'

100%[======================================>] 11,371 --.-K/s in 0.001s

2014-01-06 07:06:14 (7.89 MB/s) - written to stdout [11371/11371]

Extracting in /tmp/tmpekbOEH Now working in /tmp/tmpekbOEH/setuptools-2.0.2 Installing Setuptools running install error: can't create or remove files in install directory

The following error occurred while trying to add or remove files in the installation directory:

[Errno 13] Permission denied:

'/usr/local/lib/python2.7/dist-packages/test-easy-install-7741.write-test'

The installation directory you specified (via --install-dir, --prefix, or the distutils default setting) was:

/usr/local/lib/python2.7/dist-packages/

Perhaps your account does not have write access to this directory? If the installation directory is a system-owned directory, you may need to sign in as the administrator or "root" account. If you do not have administrative access to this machine, you may wish to choose a different installation directory, preferably one that is listed in your PYTHONPATH environment variable.

For information on other options, you may wish to consult the documentation at:

https://pythonhosted.org/setuptools/easy_install.html

Please make the appropriate changes for your system and try again.

Something went wrong during the installation. See the error message above. vagrant@precise64:~$

Reply to this email directly or view it on GitHub< https://github.com/numenta/nupic/issues/341#issuecomment-31679613> .

— Reply to this email directly or view it on GitHub.

— Reply to this email directly or view it on GitHubhttps://github.com/numenta/nupic/issues/341#issuecomment-31685083 .

— Reply to this email directly or view it on GitHub.

jefffohl commented 10 years ago

I think those ERROR messages are actually part of the tests. That is to say, the tests are mocking up failures to in order to test the catching of exceptions. I am saying this without any deep knowledge of the unit tests, however, and making this statement based on the summaries at the bottom. Matt might be able to give more insight.

rhyolight commented 10 years ago

I'm mildly concerned with the following failures:

  ======= Tests for TesterTest ==============
  Total tests: 10, Failures:      4, Disabled     : 0
  WARNING: Critical failure ocurred
  FAIL  Integer test, should fail (line: 50)
        Expected result: 1
        Actual result:   0
  FAIL  Double test, should fail (line: 51)
        Expected result: 23.42
        Actual result:   23.421
  FAIL  String test, should fail (line: 52)
        Expected result: Numenta
        Actual result:   Numenta

I'm not sure why these would fail, but if the sample application (hotgym) runs, you're probably good to go.

dfowler7437 commented 10 years ago

Thank you so much for the help Jeff,

I’m an experienced embedded system developer with not much experience with Linux…

Do you have a suggestion for how I get stated Groking NuPic? I will look over the NuMenta site and read what I can find.. Maybe you have some other pointers I should explore…

David

On Jan 6, 2014, at 3:18 PM, Jeff Fohl notifications@github.com wrote:

I think those ERROR messages are actually part of the tests. That is to say, the tests are mocking up failures to in order to test the catching of exceptions. I am saying this without any deep knowledge of the unit tests, however, and making this statement based on the summaries at the bottom. Matt might be able to give more insight.

— Reply to this email directly or view it on GitHub.

jefffohl commented 10 years ago

I am glad you were able to get it up and running David. I am also somewhat new to NuPIC, and to date have not done much but get the tests running and play with the included examples, such as hotgym. That said, I would definitely start by reading Numenta's white paper discussing the CLA (Cortical Learning Algorithm): http://numenta.org/cla-white-paper.html

What got your interest in NuPIC? Do you have a specific problem you would like to solve, or are you just generally interested in machine learning?

dfowler7437 commented 10 years ago

Here is the run for hotgym…

sudo docker run allanino/nupic /bin/bash -c "python /usr/local/src/nupic/examples/opf/clients/hotgym/hotgym.py" INFO:com.numenta.nupic.frameworks.opf.clamodel.CLAModel:Instantiated CLAModel INFO:main:After 100 records, 1-step altMAPE=22.841456 INFO:main:After 200 records, 1-step altMAPE=20.201403 INFO:main:After 300 records, 1-step altMAPE=19.638271 INFO:main:After 400 records, 1-step altMAPE=18.258557 INFO:main:After 500 records, 1-step altMAPE=17.925907 INFO:main:After 600 records, 1-step altMAPE=17.309492 INFO:main:After 700 records, 1-step altMAPE=17.241172 INFO:main:After 800 records, 1-step altMAPE=17.668295 INFO:main:After 900 records, 1-step altMAPE=17.882658 INFO:main:After 1000 records, 1-step altMAPE=18.184753 vagrant@precise64:~$ On Jan 6, 2014, at 4:13 PM, Matthew Taylor notifications@github.com wrote:

I'm mildly concerned with the following failures:

======= Tests for TesterTest ============== Total tests: 10, Failures: 4, Disabled : 0 WARNING: Critical failure ocurred FAIL Integer test, should fail (line: 50) Expected result: 1 Actual result: 0 FAIL Double test, should fail (line: 51) Expected result: 23.42 Actual result: 23.421 FAIL String test, should fail (line: 52) Expected result: Numenta Actual result: Numenta I'm not sure why these would fail, but if the sample application (hotgym) runs, you're probably good to go.

— Reply to this email directly or view it on GitHub.

rhyolight commented 10 years ago

Looks like it is working, then.


Matt Taylor OS Community Flag-Bearer Numenta

On Mon, Jan 6, 2014 at 3:54 PM, dfowler7437 notifications@github.comwrote:

Here is the run for hotgym…

sudo docker run allanino/nupic /bin/bash -c "python /usr/local/src/nupic/examples/opf/clients/hotgym/hotgym.py" INFO:com.numenta.nupic.frameworks.opf.clamodel.CLAModel:Instantiated CLAModel INFO:main:After 100 records, 1-step altMAPE=22.841456 INFO:main:After 200 records, 1-step altMAPE=20.201403 INFO:main:After 300 records, 1-step altMAPE=19.638271 INFO:main:After 400 records, 1-step altMAPE=18.258557 INFO:main:After 500 records, 1-step altMAPE=17.925907 INFO:main:After 600 records, 1-step altMAPE=17.309492 INFO:main:After 700 records, 1-step altMAPE=17.241172 INFO:main:After 800 records, 1-step altMAPE=17.668295 INFO:main:After 900 records, 1-step altMAPE=17.882658 INFO:main:After 1000 records, 1-step altMAPE=18.184753 vagrant@precise64:~$ On Jan 6, 2014, at 4:13 PM, Matthew Taylor notifications@github.com wrote:

I'm mildly concerned with the following failures:

======= Tests for TesterTest ============== Total tests: 10, Failures: 4, Disabled : 0 WARNING: Critical failure ocurred FAIL Integer test, should fail (line: 50) Expected result: 1 Actual result: 0 FAIL Double test, should fail (line: 51) Expected result: 23.42 Actual result: 23.421 FAIL String test, should fail (line: 52) Expected result: Numenta Actual result: Numenta I'm not sure why these would fail, but if the sample application (hotgym) runs, you're probably good to go.

— Reply to this email directly or view it on GitHub.

— Reply to this email directly or view it on GitHubhttps://github.com/numenta/nupic/issues/341#issuecomment-31700497 .

dfowler7437 commented 10 years ago

I work in Agriculture, typically with automatic guidance using GPS.

One of the major things I work with is crop sprayers, these machines enter into field and spray a chemical in swaths. They move back and forth in lines minimizing overspray or skipping.

We have tracking devices on some of these machines (at the operators request). I have a historical data about the movements of these machines with year long time frames. I want to create a report showing how much time the machines spent working vrs parked or traveling. Parked is easy to detect automatically, but detecting when they are actually working is not as easy. Speed is a rough indication but not really great for the purpose as they can spray at the same speed as they travel.

An initial test would be to feed the CLA with data and have it detect when a machine is actually doing a job. The machines are parked most of the time, they travel on roads between fields and once in a field they move back and forth as they apply.

I can plot this data on a Google map and its very easy for me to see that an operator is spraying, they are driving back and forth in a confined space.

I know that the CLA needs sparsely distributed data streams, so I’m thinking the heading data needs to be differentiated and spread across bits. Say a 32 bit long value where the center bit is the bias point. The real time data is filtered to an average value which is subtracted from the real-time value. This difference would be sensitive to change in direction and distributed sparsely across the bits.

Am I on track, or nuts? Could nupic be adapted to take data like this and flag that the data shows back and forth driving?

On Jan 6, 2014, at 4:48 PM, Jeff Fohl notifications@github.com wrote:

I am glad you were able to get it up and running David. I am also somewhat new to NuPIC, and to date have not done much but get the tests running and play with the included examples, such as hotgym. That said, I would definitely start by reading Numenta's white paper discussing the CLA (Cortical Learning Algorithm): http://numenta.org/cla-white-paper.html

What got your interest in NuPIC? Do you have a specific problem you would like to solve, or are you just generally interested in machine learning?

— Reply to this email directly or view it on GitHub.

rhyolight commented 10 years ago

@dfowler7437 Let me suggest that you take this comment above, exactly as you asked it, and post it on our nupic-discuss mailing list. That's where you'll get the best responses from members of our community. You'll have to subscribe yourself, but it's worth it to get your question more exposure.

Most of our community is not monitoring these Github issues (mostly just us developers).

rhyolight commented 10 years ago

Working through https://github.com/numenta/nupic/wiki/Install-NuPIC-using-Docker now...

rhyolight commented 10 years ago

Worked for me with Mac and Vagrant.