search

VowpalWabbit / vowpal_wabbit

Vowpal Wabbit is a machine learning system which pushes the frontier of machine learning with techniques such as online, hashing, allreduce, reductions, learning2search, active, and interactive learning.
https://vowpalwabbit.org
Other
8.48k stars 1.93k forks source link

Trouble caching file #385

Closed ghost closed 10 years ago

ghost commented 10 years ago

Hi all,

I'm not sure if I'm trying to cache the file incorrectly or if there may be an issue with my version of vw. I installed vw on my Mac (osx 10.9) using brew install vowpal-wabbit. This works well, and I get reasonable predictions, but when I try to cache the file using the -c option, I get an error saying the cache file could not be found and no new file is created.

Please let me know if anyone has any ideas.

Best wishes, Igor 


igor ~/p/k/CTR > vw --data click.train.vw
Num weight bits = 18
learning rate = 0.5
initial_t = 0
power_t = 0.5
using no cache
Reading datafile = click.train.vw
num sources = 1
average    since         example     example  current  current  current
loss       last          counter      weight    label  predict features
1.000000   1.000000            1         1.0  -1.0000   0.0000       37
0.709096   0.418191            2         2.0  -1.0000  -0.3533       37
0.520847   0.332599            4         4.0  -1.0000  -0.3490       24
0.727541   0.934235            8         8.0   1.0000  -0.6339       28
0.782941   0.838341           16        16.0   1.0000  -0.5522       37
0.829216   0.875491           32        32.0   1.0000  -0.1288       33
0.808635   0.788053           64        64.0  -1.0000  -0.3313       34
0.767703   0.726771          128       128.0  -1.0000  -0.8999       28
0.726833   0.685962          256       256.0  -1.0000   0.1008       34
0.727712   0.728591          512       512.0  -1.0000  -0.6623       29
0.677918   0.628125         1024      1024.0  -1.0000  -0.5308       35
0.659772   0.641626         2048      2048.0   1.0000  -0.5603       36
0.654174   0.648575         4096      4096.0  -1.0000  -1.0000       37
0.661229   0.668285         8192      8192.0  -1.0000  -1.0000       36
0.668916   0.676603        16384     16384.0  -1.0000  -0.4469       30
0.652343   0.635771        32768     32768.0  -1.0000  -0.5446       36
0.639865   0.627386        65536     65536.0  -1.0000  -0.6624       31
0.643148   0.646431       131072    131072.0  -1.0000  -0.3043       36
0.666755   0.690362       262144    262144.0  -1.0000  -0.3602       38
0.671669   0.676583       524288    524288.0   1.0000  -0.9234       27
^Cfish: Job 1, 'vw --data click.train.vw' terminated by signal SIGINT (Quit request from job control (^C))

igor ~/p/k/CTR > vw --data click.train.vw -c
Num weight bits = 18
learning rate = 0.5
initial_t = 0
power_t = 0.5
can't open: click.train.vw.cache, error = No such file or directory
fish: Job 1, 'vw --data click.train.vw -c' terminated by signal SIGSEGV (Address boundary error)
JohnLangford commented 10 years ago

This is almost surely fixed in the current master. Can you update to a newer version?

-John

On 09/03/2014 02:26 AM, Igor Nikolskiy wrote:

Hi all,

I'm not sure if I'm trying to cache the file incorrectly or if there may be an issue with my version of vw. I installed vw on my Mac (osx 10.9) using brew install vowpal-wabbit. This works well, and I get reasonable predictions, but when I try to cache the file using the -c option, I get an error saying the cache file could not be found and no new file is created.

Please let me know if anyone has any ideas.

Best wishes, Igor

Num weight bits = 18 learning rate = 0.5 initial_t = 0 power_t = 0.5 using no cache Reading datafile = click.train.vw num sources = 1 average since example example current current current loss last counter weight label predict features 1.000000 1.000000 1 1.0 -1.0000 0.0000 37 0.709096 0.418191 2 2.0 -1.0000 -0.3533 37 0.520847 0.332599 4 4.0 -1.0000 -0.3490 24 0.727541 0.934235 8 8.0 1.0000 -0.6339 28 0.782941 0.838341 16 16.0 1.0000 -0.5522 37 0.829216 0.875491 32 32.0 1.0000 -0.1288 33 0.808635 0.788053 64 64.0 -1.0000 -0.3313 34 0.767703 0.726771 128 128.0 -1.0000 -0.8999 28 0.726833 0.685962 256 256.0 -1.0000 0.1008 34 0.727712 0.728591 512 512.0 -1.0000 -0.6623 29 0.677918 0.628125 1024 1024.0 -1.0000 -0.5308 35 0.659772 0.641626 2048 2048.0 1.0000 -0.5603 36 0.654174 0.648575 4096 4096.0 -1.0000 -1.0000 37 0.661229 0.668285 8192 8192.0 -1.0000 -1.0000 36 0.668916 0.676603 16384 16384.0 -1.0000 -0.4469 30 0.652343 0.635771 32768 32768.0 -1.0000 -0.5446 36 0.639865 0.627386 65536 65536.0 -1.0000 -0.6624 31 0.643148 0.646431 131072 131072.0 -1.0000 -0.3043 36 0.666755 0.690362 262144 262144.0 -1.0000 -0.3602 38 0.671669 0.676583 524288 524288.0 1.0000 -0.9234 27 ^Cfish: Job 1, 'vw --data click.train.vw' terminated by signal SIGINT (Quit request from job control (^C))

igor ~/p/k/CTR > vw --data click.train.vw -c Num weight bits = 18 learning rate = 0.5 initial_t = 0 power_t = 0.5 can't open: click.train.vw.cache, error = No such file or directory fish: Job 1, 'vw --data click.train.vw -c' terminated by signal SIGSEGV (Address boundary error) |

— Reply to this email directly or view it on GitHub https://github.com/JohnLangford/vowpal_wabbit/issues/385.

ghost commented 10 years ago

Hi John,

Are there recommended install instructions for maca? My current installed version of vw is from homebrew

igor ~/p/k/CTR > brew upgrade vowpal-wabbit Error: vowpal-wabbit-7.6 already installed

I downloaded the latest stable release from the github, but it won’t compile because of an issue with python.

igor ~/p/m/vowpal_wabbit-master > make cd vowpalwabbit; /Applications/Xcode.app/Contents/Developer/usr/bin/make -j 8 things make[1]: Nothing to be done for things'. cd cluster; /Applications/Xcode.app/Contents/Developer/usr/bin/make make[1]: Nothing to be done forall'. cd library; /Applications/Xcode.app/Contents/Developer/usr/bin/make -j 8 make[1]: Nothing to be done for `all'. cd python; /Applications/Xcode.app/Contents/Developer/usr/bin/make things /usr/bin/clang++ -shared -Wl,--export-dynamic pylibvw.o -L /usr/local/lib -L /opt/local/lib -L/usr/lib/python2.7/config -lpython2.7 -L ../vowpalwabbit -l vw -l allreduce -L /usr/local/lib -L /opt/local/lib -lboost_program_options-mt -lboost_serialization-mt -l pthread -l z -l boost_python -o pylibvw.so ld: unknown option: --export-dynamic clang: error: linker command failed with exit code 1 (use -v to see invocation) make[1]: * [pylibvw.so] Error 1 make: * [python] Error 2

Finally if I try the ./autogen.sh script before make, I get the following error

igor ~/p/m/vowpal_wabbit-master > ./autogen.sh

glibtoolize: putting auxiliary files in .'. glibtoolize: copying file./ltmain.sh' glibtoolize: putting macros in AC_CONFIG_MACRO_DIR, acinclude.d'. glibtoolize: copying fileacinclude.d/libtool.m4' glibtoolize: copying file acinclude.d/ltoptions.m4' glibtoolize: copying fileacinclude.d/ltsugar.m4' glibtoolize: copying file acinclude.d/ltversion.m4' glibtoolize: copying fileacinclude.d/lt~obsolete.m4' configure.ac:3: error: 'AM_CONFIG_HEADER': this macro is obsolete. You should use the 'AC_CONFIG_HEADERS' macro instead. /usr/local/Cellar/automake/1.13.1/share/aclocal-1.13/obsolete-err.m4:14: AM_CONFIG_HEADER is expanded from... configure.ac:3: the top level autom4te: /usr/bin/m4 failed with exit status: 1 aclocal: error: echo failed with exit status: 1

Igor

On Sep 3, 2014, at 7:28 AM, John notifications@github.com wrote:

This is almost surely fixed in the current master. Can you update to a newer version?

-John

On 09/03/2014 02:26 AM, Igor Nikolskiy wrote:

Hi all,

I'm not sure if I'm trying to cache the file incorrectly or if there may be an issue with my version of vw. I installed vw on my Mac (osx 10.9) using brew install vowpal-wabbit. This works well, and I get reasonable predictions, but when I try to cache the file using the -c option, I get an error saying the cache file could not be found and no new file is created.

Please let me know if anyone has any ideas.

Best wishes, Igor

Num weight bits = 18 learning rate = 0.5 initial_t = 0 power_t = 0.5 using no cache Reading datafile = click.train.vw num sources = 1 average since example example current current current loss last counter weight label predict features 1.000000 1.000000 1 1.0 -1.0000 0.0000 37 0.709096 0.418191 2 2.0 -1.0000 -0.3533 37 0.520847 0.332599 4 4.0 -1.0000 -0.3490 24 0.727541 0.934235 8 8.0 1.0000 -0.6339 28 0.782941 0.838341 16 16.0 1.0000 -0.5522 37 0.829216 0.875491 32 32.0 1.0000 -0.1288 33 0.808635 0.788053 64 64.0 -1.0000 -0.3313 34 0.767703 0.726771 128 128.0 -1.0000 -0.8999 28 0.726833 0.685962 256 256.0 -1.0000 0.1008 34 0.727712 0.728591 512 512.0 -1.0000 -0.6623 29 0.677918 0.628125 1024 1024.0 -1.0000 -0.5308 35 0.659772 0.641626 2048 2048.0 1.0000 -0.5603 36 0.654174 0.648575 4096 4096.0 -1.0000 -1.0000 37 0.661229 0.668285 8192 8192.0 -1.0000 -1.0000 36 0.668916 0.676603 16384 16384.0 -1.0000 -0.4469 30 0.652343 0.635771 32768 32768.0 -1.0000 -0.5446 36 0.639865 0.627386 65536 65536.0 -1.0000 -0.6624 31 0.643148 0.646431 131072 131072.0 -1.0000 -0.3043 36 0.666755 0.690362 262144 262144.0 -1.0000 -0.3602 38 0.671669 0.676583 524288 524288.0 1.0000 -0.9234 27 ^Cfish: Job 1, 'vw --data click.train.vw' terminated by signal SIGINT (Quit request from job control (^C))

igor ~/p/k/CTR > vw --data click.train.vw -c Num weight bits = 18 learning rate = 0.5 initial_t = 0 power_t = 0.5 can't open: click.train.vw.cache, error = No such file or directory fish: Job 1, 'vw --data click.train.vw -c' terminated by signal SIGSEGV (Address boundary error) |

— Reply to this email directly or view it on GitHub https://github.com/JohnLangford/vowpal_wabbit/issues/385.

— Reply to this email directly or view it on GitHub.

JohnLangford commented 10 years ago

Apparently, clang++ takes a different argument from g++. But, you probably don't need the python interface?

The autoconfig brokenness is new---I haven't seen that before.

-John

On Wed, Sep 3, 2014 at 8:04 AM, Igor Nikolskiy notifications@github.com wrote:

Hi John,

Are there recommended install instructions for maca? My current installed version of vw is from homebrew

igor ~/p/k/CTR > brew upgrade vowpal-wabbit Error: vowpal-wabbit-7.6 already installed

I downloaded the latest stable release from the github, but it won't compile because of an issue with python.

igor ~/p/m/vowpal_wabbit-master > make cd vowpalwabbit; /Applications/Xcode.app/Contents/Developer/usr/bin/make -j 8 things make[1]: Nothing to be done for things'. cd cluster; /Applications/Xcode.app/Contents/Developer/usr/bin/make make[1]: Nothing to be done forall'. cd library; /Applications/Xcode.app/Contents/Developer/usr/bin/make -j 8 make[1]: Nothing to be done for `all'. cd python; /Applications/Xcode.app/Contents/Developer/usr/bin/make things /usr/bin/clang++ -shared -Wl,--export-dynamic pylibvw.o -L /usr/local/lib -L /opt/local/lib -L/usr/lib/python2.7/config -lpython2.7 -L ../vowpalwabbit -l vw -l allreduce -L /usr/local/lib -L /opt/local/lib -lboost_program_options-mt -lboost_serialization-mt -l pthread -l z -l boost_python -o pylibvw.so ld: unknown option: --export-dynamic clang: error: linker command failed with exit code 1 (use -v to see invocation) make[1]: * [pylibvw.so] Error 1 make: * [python] Error 2

Finally if I try the ./autogen.sh script before make, I get the following error

igor ~/p/m/vowpal_wabbit-master > ./autogen.sh

glibtoolize: putting auxiliary files in .'. glibtoolize: copying file./ltmain.sh' glibtoolize: putting macros in AC_CONFIG_MACRO_DIR, acinclude.d'. glibtoolize: copying fileacinclude.d/libtool.m4' glibtoolize: copying file acinclude.d/ltoptions.m4' glibtoolize: copying fileacinclude.d/ltsugar.m4' glibtoolize: copying file acinclude.d/ltversion.m4' glibtoolize: copying fileacinclude.d/lt~obsolete.m4' configure.ac:3: error: 'AM_CONFIG_HEADER': this macro is obsolete. You should use the 'AC_CONFIG_HEADERS' macro instead. /usr/local/Cellar/automake/1.13.1/share/aclocal-1.13/obsolete-err.m4:14: AM_CONFIG_HEADER is expanded from... configure.ac:3: the top level autom4te: /usr/bin/m4 failed with exit status: 1 aclocal: error: echo failed with exit status: 1

Igor

On Sep 3, 2014, at 7:28 AM, John notifications@github.com wrote:

This is almost surely fixed in the current master. Can you update to a newer version?

-John

On 09/03/2014 02:26 AM, Igor Nikolskiy wrote:

Hi all,

I'm not sure if I'm trying to cache the file incorrectly or if there may be an issue with my version of vw. I installed vw on my Mac (osx 10.9) using brew install vowpal-wabbit. This works well, and I get reasonable predictions, but when I try to cache the file using the -c option, I get an error saying the cache file could not be found and no new file is created.

Please let me know if anyone has any ideas.

Best wishes, Igor

Num weight bits = 18 learning rate = 0.5 initial_t = 0 power_t = 0.5 using no cache Reading datafile = click.train.vw num sources = 1 average since example example current current current loss last counter weight label predict features 1.000000 1.000000 1 1.0 -1.0000 0.0000 37 0.709096 0.418191 2 2.0 -1.0000 -0.3533 37 0.520847 0.332599 4 4.0 -1.0000 -0.3490 24 0.727541 0.934235 8 8.0 1.0000 -0.6339 28 0.782941 0.838341 16 16.0 1.0000 -0.5522 37 0.829216 0.875491 32 32.0 1.0000 -0.1288 33 0.808635 0.788053 64 64.0 -1.0000 -0.3313 34 0.767703 0.726771 128 128.0 -1.0000 -0.8999 28 0.726833 0.685962 256 256.0 -1.0000 0.1008 34 0.727712 0.728591 512 512.0 -1.0000 -0.6623 29 0.677918 0.628125 1024 1024.0 -1.0000 -0.5308 35 0.659772 0.641626 2048 2048.0 1.0000 -0.5603 36 0.654174 0.648575 4096 4096.0 -1.0000 -1.0000 37 0.661229 0.668285 8192 8192.0 -1.0000 -1.0000 36 0.668916 0.676603 16384 16384.0 -1.0000 -0.4469 30 0.652343 0.635771 32768 32768.0 -1.0000 -0.5446 36 0.639865 0.627386 65536 65536.0 -1.0000 -0.6624 31 0.643148 0.646431 131072 131072.0 -1.0000 -0.3043 36 0.666755 0.690362 262144 262144.0 -1.0000 -0.3602 38 0.671669 0.676583 524288 524288.0 1.0000 -0.9234 27 ^Cfish: Job 1, 'vw --data click.train.vw' terminated by signal SIGINT (Quit request from job control (^C))

igor ~/p/k/CTR > vw --data click.train.vw -c Num weight bits = 18 learning rate = 0.5 initial_t = 0 power_t = 0.5 can't open: click.train.vw.cache, error = No such file or directory fish: Job 1, 'vw --data click.train.vw -c' terminated by signal SIGSEGV (Address boundary error) |

Reply to this email directly or view it on GitHub https://github.com/JohnLangford/vowpal_wabbit/issues/385.

Reply to this email directly or view it on GitHub.

Reply to this email directly or view it on GitHub https://github.com/JohnLangford/vowpal_wabbit/issues/385#issuecomment-54286433 .

JohnLangford commented 10 years ago

I updated configure.ac to use AC_CONFIG_HEADERS. The other issue (--export-dynamic not working with clang++) seems more subtle. The best advice at the moment is "use g++".