GuillaumePressiat
commented
5 years ago Hi,
First, thanks for this package (and also udpipe). I use it and it works fine on my Ubuntu. This command doesn't finish in R : (Starspace alone works normally on my Mac).
model <- embed_tagspace(x = dekamer$x, y = dekamer$y,
dim = 50,
lr = 0.01, epoch = 40, loss = "softmax", adagrad = TRUE,
similarity = "cosine", negSearchLimit = 50,
ngrams = 2, minCount = 2)For debugging, I've started with lldb as suggested here but I have the same infinite time.
Here is what is printed in Terminal :
(some warnings on build about "non-virtual destructor" but it seems ok).
Last login: Tue Jan 22 20:08:42 on ttys000
MacBook-Pro-de-Guillaume:~ guillaumepressiat$ cd ~/Documents/debugs/
MacBook-Pro-de-Guillaume:debugs guillaumepressiat$ git clone https://github.com/bnosac/ruimtehol.git
Cloning into 'ruimtehol'...
remote: Enumerating objects: 174, done.
remote: Counting objects: 100% (174/174), done.
remote: Compressing objects: 100% (97/97), done.
remote: Total 1174 (delta 102), reused 130 (delta 77), pack-reused 1000
Receiving objects: 100% (1174/1174), 40.08 MiB | 5.86 MiB/s, done.
Resolving deltas: 100% (810/810), done.
MacBook-Pro-de-Guillaume:debugs guillaumepressiat$ cd ruimtehol
MacBook-Pro-de-Guillaume:ruimtehol guillaumepressiat$ R --debugger=lldb
(lldb) target create "/Library/Frameworks/R.framework/Resources/bin/exec/R"
Current executable set to '/Library/Frameworks/R.framework/Resources/bin/exec/R' (x86_64).
(lldb) run
Process 50199 launched: '/Library/Frameworks/R.framework/Resources/bin/exec/R' (x86_64)
R version 3.4.4 (2018-03-15) -- "Someone to Lean On"
Copyright (C) 2018 The R Foundation for Statistical Computing
Platform: x86_64-apple-darwin15.6.0 (64-bit)
R est un logiciel libre livré sans AUCUNE GARANTIE.
Vous pouvez le redistribuer sous certaines conditions.
Tapez 'license()' ou 'licence()' pour plus de détails.
R est un projet collaboratif avec de nombreux contributeurs.
Tapez 'contributors()' pour plus d'information et
'citation()' pour la façon de le citer dans les publications.
Tapez 'demo()' pour des démonstrations, 'help()' pour l'aide
en ligne ou 'help.start()' pour obtenir l'aide au format HTML.
Tapez 'q()' pour quitter R.
> devtools::load_all()
Loading ruimtehol
Re-compiling ruimtehol
'/Library/Frameworks/R.framework/Resources/bin/R' --no-site-file --no-environ \
--no-save --no-restore --quiet CMD INSTALL \
'/Users/guillaumepressiat/Documents/debugs/ruimtehol' \
--library='/var/folders/rk/mm6mn1y50ll38rhm2ft7ndj80000gn/T//Rtmpps9Fdm/devtools_install_c41747c27418' \
--no-R --no-data --no-help --no-demo --no-inst --no-docs --no-exec \
--no-multiarch --no-test-load --preclean
* installing *source* package ‘ruimtehol’ ...
** libs
clang++ -std=gnu++11 -I/Library/Frameworks/R.framework/Resources/include -DNDEBUG -DSTRICT_R_HEADERS -DBOOST_NO_AUTO_PTR -include compliance.h -I./Starspace/src -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/Rcpp/include" -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/BH/include" -I/usr/local/include -fPIC -Wall -g -O2 -c Starspace/src/utils/args.cpp -o Starspace/src/utils/args.o
clang++ -std=gnu++11 -I/Library/Frameworks/R.framework/Resources/include -DNDEBUG -DSTRICT_R_HEADERS -DBOOST_NO_AUTO_PTR -include compliance.h -I./Starspace/src -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/Rcpp/include" -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/BH/include" -I/usr/local/include -fPIC -Wall -g -O2 -c Starspace/src/utils/normalize.cpp -o Starspace/src/utils/normalize.o
clang++ -std=gnu++11 -I/Library/Frameworks/R.framework/Resources/include -DNDEBUG -DSTRICT_R_HEADERS -DBOOST_NO_AUTO_PTR -include compliance.h -I./Starspace/src -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/Rcpp/include" -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/BH/include" -I/usr/local/include -fPIC -Wall -g -O2 -c Starspace/src/utils/utils.cpp -o Starspace/src/utils/utils.o
clang++ -std=gnu++11 -I/Library/Frameworks/R.framework/Resources/include -DNDEBUG -DSTRICT_R_HEADERS -DBOOST_NO_AUTO_PTR -include compliance.h -I./Starspace/src -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/Rcpp/include" -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/BH/include" -I/usr/local/include -fPIC -Wall -g -O2 -c Starspace/src/data.cpp -o Starspace/src/data.o
clang++ -std=gnu++11 -I/Library/Frameworks/R.framework/Resources/include -DNDEBUG -DSTRICT_R_HEADERS -DBOOST_NO_AUTO_PTR -include compliance.h -I./Starspace/src -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/Rcpp/include" -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/BH/include" -I/usr/local/include -fPIC -Wall -g -O2 -c Starspace/src/dict.cpp -o Starspace/src/dict.o
clang++ -std=gnu++11 -I/Library/Frameworks/R.framework/Resources/include -DNDEBUG -DSTRICT_R_HEADERS -DBOOST_NO_AUTO_PTR -include compliance.h -I./Starspace/src -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/Rcpp/include" -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/BH/include" -I/usr/local/include -fPIC -Wall -g -O2 -c Starspace/src/doc_data.cpp -o Starspace/src/doc_data.o
clang++ -std=gnu++11 -I/Library/Frameworks/R.framework/Resources/include -DNDEBUG -DSTRICT_R_HEADERS -DBOOST_NO_AUTO_PTR -include compliance.h -I./Starspace/src -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/Rcpp/include" -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/BH/include" -I/usr/local/include -fPIC -Wall -g -O2 -c Starspace/src/doc_parser.cpp -o Starspace/src/doc_parser.o
clang++ -std=gnu++11 -I/Library/Frameworks/R.framework/Resources/include -DNDEBUG -DSTRICT_R_HEADERS -DBOOST_NO_AUTO_PTR -include compliance.h -I./Starspace/src -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/Rcpp/include" -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/BH/include" -I/usr/local/include -fPIC -Wall -g -O2 -c Starspace/src/model.cpp -o Starspace/src/model.o
clang++ -std=gnu++11 -I/Library/Frameworks/R.framework/Resources/include -DNDEBUG -DSTRICT_R_HEADERS -DBOOST_NO_AUTO_PTR -include compliance.h -I./Starspace/src -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/Rcpp/include" -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/BH/include" -I/usr/local/include -fPIC -Wall -g -O2 -c Starspace/src/parser.cpp -o Starspace/src/parser.o
clang++ -std=gnu++11 -I/Library/Frameworks/R.framework/Resources/include -DNDEBUG -DSTRICT_R_HEADERS -DBOOST_NO_AUTO_PTR -include compliance.h -I./Starspace/src -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/Rcpp/include" -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/BH/include" -I/usr/local/include -fPIC -Wall -g -O2 -c Starspace/src/proj.cpp -o Starspace/src/proj.o
clang++ -std=gnu++11 -I/Library/Frameworks/R.framework/Resources/include -DNDEBUG -DSTRICT_R_HEADERS -DBOOST_NO_AUTO_PTR -include compliance.h -I./Starspace/src -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/Rcpp/include" -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/BH/include" -I/usr/local/include -fPIC -Wall -g -O2 -c Starspace/src/starspace.cpp -o Starspace/src/starspace.o
In file included from <built-in>:1:
In file included from ./compliance.h:3:
In file included from /Library/Frameworks/R.framework/Versions/3.4/Resources/library/Rcpp/include/Rcpp.h:27:
In file included from /Library/Frameworks/R.framework/Versions/3.4/Resources/library/Rcpp/include/RcppCommon.h:29:
In file included from /Library/Frameworks/R.framework/Versions/3.4/Resources/library/Rcpp/include/Rcpp/r/headers.h:59:
In file included from /Library/Frameworks/R.framework/Versions/3.4/Resources/library/Rcpp/include/Rcpp/platform/compiler.h:153:
In file included from /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/unordered_map:369:
In file included from /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/__hash_table:16:
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/memory:3656:5: warning:
destructor called on non-final 'starspace::DataParser' that has virtual
functions but non-virtual destructor [-Wdelete-non-virtual-dtor]
__data_.second().~_Tp();
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/memory:3617:9: note:
in instantiation of member function
'std::__1::__shared_ptr_emplace<starspace::DataParser,
std::__1::allocator<starspace::DataParser> >::__on_zero_shared' requested
here
__shared_ptr_emplace(_Alloc __a, _Args&& ...__args)
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/memory:4277:26: note:
in instantiation of function template specialization
'std::__1::__shared_ptr_emplace<starspace::DataParser,
std::__1::allocator<starspace::DataParser>
>::__shared_ptr_emplace<std::__1::shared_ptr<starspace::Dictionary> &,
std::__1::shared_ptr<starspace::Args> &>' requested here
::new(__hold2.get()) _CntrlBlk(__a2, _VSTD::forward<_Args>(__args)...);
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/memory:4656:29: note:
in instantiation of function template specialization
'std::__1::shared_ptr<starspace::DataParser>::make_shared<std::__1::shared_ptr<starspace::Dictionary>
&, std::__1::shared_ptr<starspace::Args> &>' requested here
return shared_ptr<_Tp>::make_shared(_VSTD::forward<_Args>(__args)...);
^
Starspace/src/starspace.cpp:35:15: note: in instantiation of function template
specialization 'std::__1::make_shared<starspace::DataParser,
std::__1::shared_ptr<starspace::Dictionary> &,
std::__1::shared_ptr<starspace::Args> &>' requested here
parser_ = make_shared<DataParser>(dict_, args_);
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/memory:3656:23: note:
qualify call to silence this warning
__data_.second().~_Tp();
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/memory:3656:5: warning:
destructor called on non-final 'starspace::LayerDataParser' that has
virtual functions but non-virtual destructor [-Wdelete-non-virtual-dtor]
__data_.second().~_Tp();
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/memory:3617:9: note:
in instantiation of member function
'std::__1::__shared_ptr_emplace<starspace::LayerDataParser,
std::__1::allocator<starspace::LayerDataParser> >::__on_zero_shared'
requested here
__shared_ptr_emplace(_Alloc __a, _Args&& ...__args)
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/memory:4277:26: note:
in instantiation of function template specialization
'std::__1::__shared_ptr_emplace<starspace::LayerDataParser,
std::__1::allocator<starspace::LayerDataParser>
>::__shared_ptr_emplace<std::__1::shared_ptr<starspace::Dictionary> &,
std::__1::shared_ptr<starspace::Args> &>' requested here
::new(__hold2.get()) _CntrlBlk(__a2, _VSTD::forward<_Args>(__args)...);
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/memory:4656:29: note:
in instantiation of function template specialization
'std::__1::shared_ptr<starspace::LayerDataParser>::make_shared<std::__1::shared_ptr<starspace::Dictionary>
&, std::__1::shared_ptr<starspace::Args> &>' requested here
return shared_ptr<_Tp>::make_shared(_VSTD::forward<_Args>(__args)...);
^
Starspace/src/starspace.cpp:37:15: note: in instantiation of function template
specialization 'std::__1::make_shared<starspace::LayerDataParser,
std::__1::shared_ptr<starspace::Dictionary> &,
std::__1::shared_ptr<starspace::Args> &>' requested here
parser_ = make_shared<LayerDataParser>(dict_, args_);
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/memory:3656:23: note:
qualify call to silence this warning
__data_.second().~_Tp();
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/memory:3656:5: warning:
destructor called on non-final 'starspace::InternDataHandler' that has
virtual functions but non-virtual destructor [-Wdelete-non-virtual-dtor]
__data_.second().~_Tp();
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/memory:3617:9: note:
in instantiation of member function
'std::__1::__shared_ptr_emplace<starspace::InternDataHandler,
std::__1::allocator<starspace::InternDataHandler> >::__on_zero_shared'
requested here
__shared_ptr_emplace(_Alloc __a, _Args&& ...__args)
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/memory:4277:26: note:
in instantiation of function template specialization
'std::__1::__shared_ptr_emplace<starspace::InternDataHandler,
std::__1::allocator<starspace::InternDataHandler>
>::__shared_ptr_emplace<std::__1::shared_ptr<starspace::Args> &>'
requested here
::new(__hold2.get()) _CntrlBlk(__a2, _VSTD::forward<_Args>(__args)...);
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/memory:4656:29: note:
in instantiation of function template specialization
'std::__1::shared_ptr<starspace::InternDataHandler>::make_shared<std::__1::shared_ptr<starspace::Args>
&>' requested here
return shared_ptr<_Tp>::make_shared(_VSTD::forward<_Args>(__args)...);
^
Starspace/src/starspace.cpp:63:12: note: in instantiation of function template
specialization 'std::__1::make_shared<starspace::InternDataHandler,
std::__1::shared_ptr<starspace::Args> &>' requested here
return make_shared<InternDataHandler>(args_);
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/memory:3656:23: note:
qualify call to silence this warning
__data_.second().~_Tp();
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/memory:3656:5: warning:
destructor called on non-final 'starspace::LayerDataHandler' that has
virtual functions but non-virtual destructor [-Wdelete-non-virtual-dtor]
__data_.second().~_Tp();
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/memory:3617:9: note:
in instantiation of member function
'std::__1::__shared_ptr_emplace<starspace::LayerDataHandler,
std::__1::allocator<starspace::LayerDataHandler> >::__on_zero_shared'
requested here
__shared_ptr_emplace(_Alloc __a, _Args&& ...__args)
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/memory:4277:26: note:
in instantiation of function template specialization
'std::__1::__shared_ptr_emplace<starspace::LayerDataHandler,
std::__1::allocator<starspace::LayerDataHandler>
>::__shared_ptr_emplace<std::__1::shared_ptr<starspace::Args> &>'
requested here
::new(__hold2.get()) _CntrlBlk(__a2, _VSTD::forward<_Args>(__args)...);
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/memory:4656:29: note:
in instantiation of function template specialization
'std::__1::shared_ptr<starspace::LayerDataHandler>::make_shared<std::__1::shared_ptr<starspace::Args>
&>' requested here
return shared_ptr<_Tp>::make_shared(_VSTD::forward<_Args>(__args)...);
^
Starspace/src/starspace.cpp:65:12: note: in instantiation of function template
specialization 'std::__1::make_shared<starspace::LayerDataHandler,
std::__1::shared_ptr<starspace::Args> &>' requested here
return make_shared<LayerDataHandler>(args_);
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/memory:3656:23: note:
qualify call to silence this warning
__data_.second().~_Tp();
^
4 warnings generated.
clang++ -std=gnu++11 -I/Library/Frameworks/R.framework/Resources/include -DNDEBUG -DSTRICT_R_HEADERS -DBOOST_NO_AUTO_PTR -include compliance.h -I./Starspace/src -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/Rcpp/include" -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/BH/include" -I/usr/local/include -fPIC -Wall -g -O2 -c rcpp_textspace.cpp -o rcpp_textspace.o
clang++ -std=gnu++11 -I/Library/Frameworks/R.framework/Resources/include -DNDEBUG -DSTRICT_R_HEADERS -DBOOST_NO_AUTO_PTR -include compliance.h -I./Starspace/src -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/Rcpp/include" -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/BH/include" -I/usr/local/include -fPIC -Wall -g -O2 -c compliance.cpp -o compliance.o
clang++ -std=gnu++11 -I/Library/Frameworks/R.framework/Resources/include -DNDEBUG -DSTRICT_R_HEADERS -DBOOST_NO_AUTO_PTR -include compliance.h -I./Starspace/src -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/Rcpp/include" -I"/Library/Frameworks/R.framework/Versions/3.4/Resources/library/BH/include" -I/usr/local/include -fPIC -Wall -g -O2 -c RcppExports.cpp -o RcppExports.o
clang++ -std=gnu++11 -dynamiclib -Wl,-headerpad_max_install_names -undefined dynamic_lookup -single_module -multiply_defined suppress -L/Library/Frameworks/R.framework/Resources/lib -L/usr/local/lib -o ruimtehol.so Starspace/src/utils/args.o Starspace/src/utils/normalize.o Starspace/src/utils/utils.o Starspace/src/data.o Starspace/src/dict.o Starspace/src/doc_data.o Starspace/src/doc_parser.o Starspace/src/model.o Starspace/src/parser.o Starspace/src/proj.o Starspace/src/starspace.o rcpp_textspace.o compliance.o RcppExports.o -pthread -F/Library/Frameworks/R.framework/.. -framework R -Wl,-framework -Wl,CoreFoundation
rm -f Starspace/src/utils/args.o Starspace/src/utils/normalize.o Starspace/src/utils/utils.o Starspace/src/data.o Starspace/src/dict.o Starspace/src/doc_data.o Starspace/src/doc_parser.o Starspace/src/model.o Starspace/src/parser.o Starspace/src/proj.o Starspace/src/starspace.o rcpp_textspace.o compliance.o RcppExports.o
installing to /private/var/folders/rk/mm6mn1y50ll38rhm2ft7ndj80000gn/T/Rtmpps9Fdm/devtools_install_c41747c27418/ruimtehol/libs
* DONE (ruimtehol)
> data("dekamer", package = "ruimtehol")
> dekamer$x <- strsplit(dekamer$question, "\\W")
dekamer$x <- sapply(dekamer$x, FUN = function(x) paste(setdiff(x, ""), collapse = " "))
dekamer$x <- tolower(dekamer$x)
dekamer$y <- strsplit(dekamer$question_theme, split = ",")
dekamer$y <- lapply(dekamer$y, FUN=function(x) gsub(" ", "-", x))
set.seed(123456789)
e = " "))$x <- sapply(dekamer$x, FUN = function(x) paste(setdiff(x, ""), collaps
> dekamer$x <- tolower(dekamer$x)
> dekamer$y <- strsplit(dekamer$question_theme, split = ",")
> dekamer$y <- lapply(dekamer$y, FUN=function(x) gsub(" ", "-", x))
>
> set.seed(123456789)
> model <- embed_tagspace(x = dekamer$x, y = dekamer$y,
+ dim = 50,
+ lr = 0.01, epoch = 40, loss = "softmax", adagrad = TRUE,
+ similarity = "cosine", negSearchLimit = 50,
+ ngrams = 2, minCount = 2)
>
Start to initialize starspace model.
Build dict from input file : /var/folders/rk/mm6mn1y50ll38rhm2ft7ndj80000gn/T//Rtmpps9Fdm/textspace_c4172f53f876.txt
Read 0M words
Number of words in dictionary: 13417
Number of labels in dictionary: 1299
Loading data from file : /var/folders/rk/mm6mn1y50ll38rhm2ft7ndj80000gn/T//Rtmpps9Fdm/textspace_c4172f53f876.txt
Total number of examples loaded : 2858
Loading data from file : /var/folders/rk/mm6mn1y50ll38rhm2ft7ndj80000gn/T//Rtmpps9Fdm/textspace_validation_c41731dd2340.txt
Total number of examples loaded : 952
2019-01-22 20:26:21 Start training epoch 1 with learning rate 0.01... Then I wait but nothing so I stopped it
Process 50199 stopped
* thread #1, queue = 'com.apple.main-thread', stop reason = signal SIGSTOP
frame #0: 0x00007fff5c9d194e libsystem_kernel.dylib`__ulock_wait + 10
libsystem_kernel.dylib`__ulock_wait:
-> 0x7fff5c9d194e <+10>: jae 0x7fff5c9d1958 ; <+20>
0x7fff5c9d1950 <+12>: movq %rax, %rdi
0x7fff5c9d1953 <+15>: jmp 0x7fff5c9cf3b7 ; cerror_nocancel
0x7fff5c9d1958 <+20>: retq
Target 0: (R) stopped.Do you have an advice or a hint for next step in this bug search ? If I can help.
Guillaume
jwijffels
bob-rietveld
who has a mac os machine and is willing to do some debugging?